Hey all! I wanted to let you know about a new collaboration between Microsoft, Google, and Mozilla (and hopefully others soon): The Web We Want. We using it as a listening tool to identify issues worthy of exploration. We’re not looking for solutions, but rather problem areas. If there’s something you’re throwing a lot of code at to work around a missing API or implement some design idea, please share it. If there’s a missing feature in DevTools or a missing piece in Web Driver, we’d like to know.
We’re also going to be running pitch sessions at web design & development conferences where folks can present their wants to the community in order to get direct feedback and support for their cause. The first one is in Washington DC at An Event Apart, but we’ll also be at Smashing Conference, Beyond Tellerrand, View Source, and others TBA.
Please share your wants, we’re listening!
PS - If you’re running an event and would like to host a Web We Want session, please reach out.
Memory-efficient APIs. Garbage-collection is great when you don’t care about when the memory is freed, and an intractable problem when you do.
In particular, getting ImageData from a MediaStream (local webcam, remote feed via WebRTC, captured from a video using HTMLMediaElement.captureStream(), etc) can generate a lot of garbage if you’re doing processing on each frame and don’t care about it once you’ve processed it. Trying to process 1080p@30 FPS will generate 230 MB/sec of discarded ImageData objects, which is a lot. 4K@30 FPS would be nearly 1 GB/sec.
Leaving it up to garbage collection leaves web developers at the mercy of the implementation. With low-spec devices this often isn’t up to snuff.
You probably know that Edge has that UserVoice page where developers can vote on features that they want to see in Edge. (Of course, now that Edge is Chromium based, that page is no longer relevant unless it’s updated.)
Well, how about that UserVoice (or similar) voting system but for the web platform instead. That way we could see which missing features are really most requested.
For example, I would vote for a standard API for event throttling, among other things.
Ok, I submitted it to The Web We Want. There’s also a topic on this forum (Efficiently Get ImageData from a Video MediaStreamTrack) and a (mostly) fully-formed proposal on GitHub with a link to patch implementations for both Chromium and Firefox, and performance test results showing the impact, but from what I’ve seen in the past, it’s most likely it will continue to be met with silence.
Full implemented SpeechRecognition for Web Speech API, without any external services involved (https://github.com/w3c/speech-api/issues/56). At the very minimum the mandate that users of Web APIs should be asked permission, conspicuously, before the browser records their PII biometric data (voice) and sends the recording of their voice to an undisclosed, unknown remote web service, potentionally FOREVER, to do with what they will.
If the email is included in the form submission a reply can be sent to that email address. What difference does it make if the provided email is “real” or not?
Submitted five proposals over 7 days ago.
The linked issue does not ask for The Web We Want to accept a submission or implement the idea described therein, the issue simply asks for a very basic reply email acknowledging that The Web We Want received the form submission at all.
Did the pricipal individuals/entities involved with conceiving and announcing The Web We Want not consider acknowledging receipt of submissions before launching the website, making public announcements, and asking for developers to share issues with code and ideas?
Are the principal individuals/entities involved with The Web We Want reading individual submissions before deciding whether or not to reply to the submission?
Has The Web We Want personnel really thought this project through? Or are very basic communication practices and procedures being considered as time moves along only when brought up by the individuals who submitted forms themselves?
Why cannot an email be sent to the email included in the form submission immediately upon receiving the submission to confirm receipt of the form submission?
(Back on topic) A common theme for me is getting more APIs to work in Web Workers. With OffscreenCanvas it’s now possible to do things like advanced WebGL rendering off the main thread. But support for audio, video, media streams, WebRTC and so on is still entirely missing from workers. This can be worked around but it makes it massively more complicated to get code that works on the DOM running in a worker.
AFAIK spec issues have all been filed etc., it’s just slow progress. I’d also like to see a commitment that all new APIs are made available in a worker too, unless there’s some specific reason why it can’t be. For example the recent Web Bluetooth is DOM-only in Chrome, so even new things are still adding to the pile of things not available in a worker.