gpu-screen-recorder/TODO

Check for reparent.
Quickly changing workspace and back while recording under i3 breaks the screen recorder. i3 probably unmaps windows in other workspaces.
See https://trac.ffmpeg.org/wiki/EncodingForStreamingSites for optimizing streaming.
Look at VK_EXT_external_memory_dma_buf.
Allow setting a different output resolution than the input resolution.
Use mov+faststart.
Allow recording all monitors/selected monitor without nvfbc by recording the compositor proxy window and only recording the part that matches the monitor(s).
Allow recording a region by recording the compositor proxy window / nvfbc window and copying part of it.
Use nvenc directly, which allows removing the use of cuda.
Handle xrandr monitor change in nvfbc.
Implement follow focused in drm.
Support fullscreen capture on amd/intel using external kms process.
Support amf and qsv.
Disable flipping on nvidia? this might fix some stuttering issues on some setups. See NvCtrlGetAttribute/NvCtrlSetAttributeAndGetStatus NV_CTRL_SYNC_TO_VBLANK https://github.com/NVIDIA/nvidia-settings/blob/d5f022976368cbceb2f20b838ddb0bf992f0cfb9/src/gtk%2B-2.x/ctkopengl.c.
Replays seem to have some issues with audio/video. Why?
Cleanup unused gl/egl functions, macro, etc.
Add option to disable overlapping of replays (the old behavior kinda. Remove the whole replay buffer data after saving when doing this).
Set audio track name to audio device name (if not merge of multiple audio devices).
Add support for webcam, but only really for amd/intel because amd/intel can get drm fd access to webcam, nvidia cant. This allows us to create an opengl texture directly from the webcam fd for optimal performance.
Reverse engineer nvapi so we can disable "force p2 state" on linux too (nvapi profile api with the settings id 0x50166c5e).
Support yuv444p on amd/intel.
fix yuv444 for hevc.
Do not allow streaming if yuv444.
Re-enable yuv444.
Support 10 bit output because of better gradients. May even be smaller file size. Better supported on hevc (not supported at all on h264 on my gpu).
Add nvidia/(amd/intel) specific install script for ubuntu. User should run install_ubuntu.sh but it should run different install dep script depending on if /proc/driver/nvidia/version exists or not. But what about switchable graphics setup?
Test different combinations of switchable graphics. Intel hybrid mode (running intel but possible to run specific applications with prime-run), running pure intel. Detect switchable graphics.

https://web.archive.org/web/20210306020203/https://forums.developer.nvidia.com/t/performance-power-management-problem-on-shared-vgpu/161986
https://djdallmann.github.io/GamingPCSetup/CONTENT/RESEARCH/FINDINGS/registrykeys_displayadapter_class_4d36e968-e325-11ce-bfc1-08002be10318.txt
Add option to record a display or all displays. This requires nvfbc 2021-07-23 15:33:37 +00:00			`Check for reparent.`
Remove unecessary cuda memcpy when using nvfbc 2022-04-04 04:13:52 +00:00			`Quickly changing workspace and back while recording under i3 breaks the screen recorder. i3 probably unmaps windows in other workspaces.`
Add option to use multiple audio inputs (each in their own audio track) 2022-08-23 15:39:49 +00:00			`See https://trac.ffmpeg.org/wiki/EncodingForStreamingSites for optimizing streaming.`
Make video framerate constant, fix audio desync a bit when no audio playing for a while 2022-09-01 22:42:22 +00:00			`Look at VK_EXT_external_memory_dma_buf.`
Fix crackling audio with pipewire and only add empty audio packets until the first packet arrives 2022-09-06 12:40:34 +00:00			`Allow setting a different output resolution than the input resolution.`
			`Use mov+faststart.`
GNOME: fix recording windows with client-side decorations by recording the compositor window and tracking the window 2022-09-18 16:51:37 +00:00			`Allow recording all monitors/selected monitor without nvfbc by recording the compositor proxy window and only recording the part that matches the monitor(s).`
			`Allow recording a region by recording the compositor proxy window / nvfbc window and copying part of it.`
Add info about flatpak package, default to h264 (unless resolution is greater than 3840x2160) and add -k option to set codec 2022-10-03 14:54:48 +00:00			`Use nvenc directly, which allows removing the use of cuda.`
wip intel 2022-10-17 00:55:59 +00:00			`Handle xrandr monitor change in nvfbc.`
follow focused 2022-11-30 23:47:30 +00:00			`Implement follow focused in drm.`
			`Support fullscreen capture on amd/intel using external kms process.`
Remove unused file 2022-12-29 23:35:39 +00:00			`Support amf and qsv.`
Add option to merge audio devices by separating audio inputs with \| in one -a 2023-02-16 22:39:02 +00:00			`Disable flipping on nvidia? this might fix some stuttering issues on some setups. See NvCtrlGetAttribute/NvCtrlSetAttributeAndGetStatus NV_CTRL_SYNC_TO_VBLANK https://github.com/NVIDIA/nvidia-settings/blob/d5f022976368cbceb2f20b838ddb0bf992f0cfb9/src/gtk%2B-2.x/ctkopengl.c.`
vaapi wip 2023-03-16 12:36:19 +00:00			`Replays seem to have some issues with audio/video. Why?`
Add overclocking option -oc to workaround a NVIDIA driver bug (forcefully set to p2 state when using cuda) 2023-03-17 16:17:14 +00:00			`Cleanup unused gl/egl functions, macro, etc.`
			`Add option to disable overlapping of replays (the old behavior kinda. Remove the whole replay buffer data after saving when doing this).`
			`Set audio track name to audio device name (if not merge of multiple audio devices).`
			`Add support for webcam, but only really for amd/intel because amd/intel can get drm fd access to webcam, nvidia cant. This allows us to create an opengl texture directly from the webcam fd for optimal performance.`
Add pixfmt yuv420p/yuv444p option to set lossless color 2023-03-20 16:43:11 +00:00			`Reverse engineer nvapi so we can disable "force p2 state" on linux too (nvapi profile api with the settings id 0x50166c5e).`
			`Support yuv444p on amd/intel.`
			`fix yuv444 for hevc.`
			`Do not allow streaming if yuv444.`
Remove yuv444 for now 2023-03-26 17:04:43 +00:00			`Re-enable yuv444.`
			`Support 10 bit output because of better gradients. May even be smaller file size. Better supported on hevc (not supported at all on h264 on my gpu).`
			`Add nvidia/(amd/intel) specific install script for ubuntu. User should run install_ubuntu.sh but it should run different install dep script depending on if /proc/driver/nvidia/version exists or not. But what about switchable graphics setup?`
			`Test different combinations of switchable graphics. Intel hybrid mode (running intel but possible to run specific applications with prime-run), running pure intel. Detect switchable graphics.`

			`https://web.archive.org/web/20210306020203/https://forums.developer.nvidia.com/t/performance-power-management-problem-on-shared-vgpu/161986`
			`https://djdallmann.github.io/GamingPCSetup/CONTENT/RESEARCH/FINDINGS/registrykeys_displayadapter_class_4d36e968-e325-11ce-bfc1-08002be10318.txt`