186294 2018-06-04 17:52:05 -0700 Implement getDisplayMedia, the Screen Capture API 2022-02-25 10:43:12 -0800 1 1 1 Unclassified WebKit WebRTC Safari 11 Unspecified Unspecified RESOLVED FIXED P2 Normal --- 1 lee webkit-unassigned ap argggh ben daginge eric.carlson hispejukke jer.noble jespertheend jomluvukni jonlee ldenoue lee mancas.f.george m.kurz+webkitbugs netemowihe niklasmerz octavian philipp.weissensteiner reducecode shahraship szmydadam wilhelm.wanecek youennf oldest_to_newest 1429977 0 lee 2018-06-04 17:52:05 -0700 This is a request for implementing getDisplayMedia, the Screen Capture API that is an extension to the Media Capture API. This allows a display surface to be used as a source for a media stream. Examples of display surfaces that may be supported include: monitor, window, application (entire collection of windows for an application), or browser (single browser window). Having the ability to capture and share a monitor display would be a great start. The specification is here: https://w3c.github.io/mediacapture-screen-share/ Microsoft Edge (EdgeHTML 17) added support for the Screen Capture API as part of the Windows 10 April 2018 update: https://blogs.windows.com/msedgedev/2018/05/02/bringing-screen-capture-to-microsoft-edge-media-capture-api/ Google Chrome and Mozilla Firefox have already had support for non-standard screen capture APIs for years. They have bugs tracking migrations to the standard getDisplayMedia API (Chrome: https://bugs.chromium.org/p/chromium/issues/detail?id=326740, Firefox: https://bugzilla.mozilla.org/show_bug.cgi?id=1321221). 1430208 1 eric.carlson 2018-06-05 13:50:37 -0700 getDisplayMedia is implemented (for displays only, not window, or application) on macOS behind the ScreenCapture runtime flag (off by default). See bugs 181070, 181291, and 181333. 1430359 2 lee 2018-06-05 21:50:39 -0700 That's great to hear! How do we go about enabling this ScreenCapture runtime flag? What (minimum) version of Safari is required? 1430470 3 eric.carlson 2018-06-06 09:28:59 -0700 There is no UI to enable this setting yet because the (complex) user prompt for getDisplayMedia hasn't been added to Safari yet. 1450254 4 wilhelm.wanecek 2018-08-15 01:22:38 -0700 Are there any plans to extend the implementation to include window or application? If possible, it would also be really valuable to get any sort of estimate about when the UI work for Safari is planned. 1474041 5 szmydadam 2018-11-01 00:36:12 -0700 (In reply to Eric Carlson from comment #1) > getDisplayMedia is implemented (for displays only, not window, or > application) on macOS behind the ScreenCapture runtime flag (off by > default). See bugs 181070, 181291, and 181333. How to enable this `ScreenCapture` runtime flag to prepare code for this implementation and see how it works for now? 1474070 6 eric.carlson 2018-11-01 04:58:00 -0700 (In reply to Adam Szmyd from comment #5) > How to enable this `ScreenCapture` runtime flag to prepare code for this > implementation and see how it works for now? It can only be enabled at build time currently. 1477359 7 shahraship 2018-11-10 22:47:25 -0800 +1 1481123 8 octavian 2018-11-23 07:47:57 -0800 +1 1500125 9 m.kurz+webkitbugs 2019-01-30 12:59:00 -0800 Please ship this! Chrome 72 supports it by default since yesterday: https://addpipe.com/blog/standards-compliant-screen-capture-in-chrome-72/ Firefox 66 supports this too: https://bugzilla.mozilla.org/show_bug.cgi?id=1321221 Edge supports this already since EdgeHTML 17: https://blogs.windows.com/msedgedev/2018/05/02/bringing-screen-capture-to-microsoft-edge-media-capture-api/#Amr4BHB73ZQfDKLq.97 1521213 10 reducecode 2019-03-25 22:29:53 -0700 +1 1526352 11 netemowihe 2019-04-11 05:02:24 -0700 Even Edge has this functionality. Please implement! 1526885 12 jonlee 2019-04-12 13:08:30 -0700 It is now available as an experimental feature in Safari Technology Preview. Please give it a try. We welcome your feedback! 1526909 13 jomluvukni 2019-04-12 14:31:51 -0700 I tried it out. Works great for sharing the entire screen! Would be nice if the feature allowed the user to select whether they want to share their entire screen(s), a particular window or a safari browser tab. Similar functionality exists in Chrome, Firefox and Edge. 1540381 14 hispejukke 2019-05-30 11:07:21 -0700 Some of the functionality appears to have been broken in Tech Preview 83. Granting an application permission to capture the screen works, however, even after stopping the sharing indicator continues to appear in the web address as well as in the menu bar. Attempting to "Pause", which is the only available action, does not do anything. 1540390 15 youennf 2019-05-30 11:25:43 -0700 (In reply to netemowihe from comment #14) > Some of the functionality appears to have been broken in Tech Preview 83. > Granting an application permission to capture the screen works, however, > even after stopping the sharing indicator continues to appear in the web > address as well as in the menu bar. Attempting to "Pause", which is the only > available action, does not do anything. netemowihe, would you be able to file a separate bug? Testing locally on STP83/MacOS10.14.5, I do not see any menu/address bar icons showing up for either getDisplayMedia or getUserMedia. I can see the tab icons though. 1543696 16 philipp.weissensteiner 2019-06-11 07:37:14 -0700 Hi, I noticed that a MediaStream returned by getDisplayMedia({ audio: true, video: true }) does not contain an audio track. 1543720 17 eric.carlson 2019-06-11 08:59:48 -0700 (In reply to philipp.weissensteiner from comment #16) > Hi, > > I noticed that a MediaStream returned by > > getDisplayMedia({ audio: true, video: true }) > > does not contain an audio track. That is by design, and is something the spec allows: Unlike getUserMedia with regards to audio+video, the user agent is allowed not to return audio even if the audio constraint is present. If the user agent knows no audio will be shared for the lifetime of the stream it MUST NOT include an audio track in the resulting stream. The user agent MAY accept a request for audio and video by only returning a video track in the resulting stream, or it MAY accept the request by returning both an audio track and a video track in the resulting stream. https://w3c.github.io/mediacapture-screen-share/#mediadevices-additions 1543999 18 philipp.weissensteiner 2019-06-12 01:28:39 -0700 Thanks for the clarification, Eric. Since the spec also mentions: > In the case of audio, the user agent MAY present the end-user with audio sources to share. Which choices are available to choose from is up to the user agent, and the audio source(s) are not necessarily the same as the video source(s) I'm wondering are there plans to introduce a selectable audio source for gDM? As of right now, if you were developing a screen sharing application you would have to add the audio track manually, correct? displayStream = gDM({ video: true }); audioStream = gUM({ audio: true }); displayStream.addTrack(audioStream.getAudioTracks()[0]); 1544030 19 octavian 2019-06-12 04:35:16 -0700 > As of right now, if you were developing a screen sharing application > you would have to add the audio track manually, correct? > > displayStream = gDM({ video: true }); > audioStream = gUM({ audio: true }); > > displayStream.addTrack(audioStream.getAudioTracks()[0]); That's how we're doing it in Chrome and Firefox but I've never tested it with Safari. https://blog.addpipe.com/screen-recording/ 1544139 20 eric.carlson 2019-06-12 09:32:02 -0700 (In reply to philipp.weissensteiner from comment #18) > Thanks for the clarification, Eric. > > Since the spec also mentions: > > > In the case of audio, the user agent MAY present the end-user with audio sources to share. Which choices are available to choose from is up to the user agent, and the audio source(s) are not necessarily the same as the video source(s) > > I'm wondering are there plans to introduce a selectable audio source for gDM? > > As of right now, if you were developing a screen sharing application > you would have to add the audio track manually, correct? > > displayStream = gDM({ video: true }); > audioStream = gUM({ audio: true }); > > displayStream.addTrack(audioStream.getAudioTracks()[0]); We aren't currently planning to add support for capturing microphone audio to getDisplayMedia. I see two problems, 1) microphone capture and screen capture are conceptually quite different, and 2) adding microphone capture to gDM would require something in the user prompt to make it clear to the user that the page was asking for both, and I'm afaid that it would be easy for a user to overlook the extra request. This will be especially in the much more complicated user prompt required once we support screen capture from a monitor or window. It *would* make sense to allow screen+audio capture if the audio captured was the audio output from the machine (for screen capture) or application (for window capture), but we don't have system API for that. Thanks for the feedback! We're always happy to hear about feature requests, bugs, etc - even if we aren't able to do anything as is the case here. 1715892 21 shahraship 2020-12-18 22:02:28 -0800 Now that Safari on iPadOS claims to support desktop class browsing, would we expect to see this available there as well? 1823991 22 ldenoue 2021-12-14 07:24:15 -0800 > We aren't currently planning to add support for capturing microphone audio > to getDisplayMedia. Are people working on window sharing? All other engines support picking an individual window to share instead of the entire screen, which I find useful for privacy reasons. 1846089 23 gsnedders 2022-02-25 10:43:12 -0800 Closing this as fixed given this shipped in Safari 13 in 2019.