This is easily the most exciting part of the whole announcement.
Update: looks like no: https://github.com/libarchive/libarchive/wiki/LibarchiveForm... :(
Where is zstandard or lz4 on ntfs? Meta and data checksumming and autorecovery? New and improved filesystems?
A new permanent taskbar button opens an OpenAI LLM trained to use Windows 11.
You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."
It works with all applications. It sees what you're seeing.
As a longtime Linux user, it pains me to say this:
It's... beautiful.
...
But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.
In that sense, it's like "MOTHER" in Ridely Scott's Alien and "HAL" in Kubrick's 2001: A Space Odyssey.
Sounds like it will also see prompt-injection malware hidden in plaintext documents.
I'm also a bit curious how they will actually pay to have millions of these LLMs running and how much co2 it will output. This doesn't exactly fit their narrative about the new power saving features in their consoles.
perfect summary of modern Windows
https://kai-greshake.de/posts/in-escalating-order-of-stupidi...
In the video the user drag&drops a file into the copilot window. How do you know that it can see your screen? I believe "works with all apps" only refers to the third party plugins.
Does it also snitch on you to your boss? "Here is my assessment of the work habits of cs702 for this week."
Follow it up with "And send out my resume, because I can apparently be replaced by a computer."
I mean seriously, the fact that Microsoft is this far ahead with AI (because of their partnership with OpenAI), comes off as a massive failure on Apple's part. Not only that, but Microsoft's continued positioning as dev central (Github, Github Copilot, VScode, and more) while Apple dwindles with docs that have been lacking in quality for years and only providing the bulky Xcode as a code editor is frustrating me as someone who loves coding on Mac. I love using this unix-like machine but not having to sacrifice UX by using linux. But as time goes on it makes me wonder if Apple will ever start focusing on devs again, and now AI!
The good news is I've been impressed with running various AI-type things (Stable Diffusion and llamda.cpp) locally on my M1 Max Macbook so if anyone can pull this off locally I think it's Apple.
Nowadays, the 'internet of knowledge' can be seen as a repository that's readily accessible. It's challenging, but not impossible, to create an AI system that outperforms Google Assistant. Developing something on par with GPT-4 in the immediate future? That's unlikely. We've moved from an era akin to sailboats to one more like steamships, where the pace of development is much quicker. OpenAI currently has a significant lead, but in this rapidly advancing field, the playing field could change faster than we might expect.
This was done with bash mimicking similar functionality. I am guessing it will be really easy for the Apple developers to make a really nice version since it's this easy to do a hack job [1].
https://answers.microsoft.com/en-us/windows/forum/all/restor...
(edit: tbf while I don't have Windows 11, this feels like a safe presumption)
I have zero issues with signing GitHub Copilot into my GitHub account to use it with Android Studio or VS Code, I just don't want the OS to be logged into a cloud account which I don't really own and where I don't know what's getting synced to it.
Thanks but no thanks, it is a long time ago I took a different path which leads to a different future, one which is not likely to be extinguished.
1. A cross-application connectivity layer that pipes data and actions between apps
2. A natural language interface to control #1
Thinking about them separately is useful, because although chat is the new UI hotness, #1 is valuable on its own and the two can potentially be deployed separately.
As presented here, I suspect the natural language interface will be faster and easier than buttons for operating the cross-app layer for complex queries, but potentially slower than operating buttons for simple things (like "start dark mode").
But personally, I believe #1 combined with some AI context awareness is more powerful of the features.
...
And btw, I left Apple last year to build a local-first and developer-extensible assistants for the Mac that's pretty similar. If this interests you, would love to chat (email in profile, as well as a waitlist).
Just some afternoon postulating haha
I can't get past the feeling that Windows Copilot will be used in slimy anti-privacy ways. I am somehow very sceptical that it will only use the screen's context as context for the user's queries. Probably because many new Windows 11 features have been anti-consumer, and Microsoft have been consistent at building this kind of reputation for years. It has numbed all of my excitement for anything Microsoft does.
There is also the performance issue. Right now the task energy/memory usage of llama implementations is very high, and it takes some time to load into RAM and/or VRAM. It seems Microsoft is getting around this with cloud inference, and eats the hosting cost (for now).
> little fine tuning on tool use might be all thats needed.
Maybe I am interpreting this wrong, but LORA finetuning is extremely resource intense right now. There are practical alternatives though, like embedding databases people are just now setting up.
Realistically, with the LLMs we have today, the right approach is probably to curate a set of APIs it's allowed to interact with. Some basic file system access and FFmpeg support would be extremely useful on it's own.
The fact that training a statistical model on terabytes of text can lead quite naturally and obviously to what is shown in the video in the webpage is shocking. The shocking part is how natural it feels, and how I know this is something that can work.
Congratulations to the teams that have been going down this path, this is wildly impressive stuff.
> You can now quickly identify and access any instance of each app housed in the taskbar with just one click. All instances of the app are ungrouped with labels on the taskbar.
It makes it sound like you need to click a group first to ungroup it, but maybe there's an option to keep them ungrouped by default. I guess we'll see. You can catch a glimpse of what the labeled windows in the taskbar looks like in the Dev Home video embedded in the article.
Edit: A less harmful proof of concept could be, say, turning volume up to 100% and opening fifty Edge windows with the Baby Shark video.
Would be cool to have an option to actually read those reviews. If I open Firefox page in the Store app it says 420 ratings but I can only read a single review. If I press 'See all' it just shows an empty page. If I open Firefox store page[0] in the browser it says 'No one has reviewed this application yet. Be the first to add a review.' Reviews seem to be split by country or by some other criteria for no good reason.
[0] https://apps.microsoft.com/store/detail/mozilla-firefox/9NZV...
edit: I wouldn't be surprised at all if Amazon released an office(/groupware) style suite also soon. It definitely would be an match, they already have lot of user-facing enterpricy software
Would be great if it can help you find how to do things in Office apps too, because it's the same problem. Those apps have had so many redesigns over the years, Googling for anything more complex than the most basic of usecases is impossible.
I was expecting more than suggestions for playlists and slack hooks.
Perhaps the community will whip up (most likely not), extensions for stuff like Sentry or CI/CD. Could be a neat thing then.
Everywhere they are mentioning coming soon to Windows 11, but considering they are projecting it as a developer focussed instead of for normal people i get the vibe it is not for Home edition.
I hope it's possible to remove the AI controls (especially the copilot button) from the UI.
We have confidentiality agreements that I'm not sure would pass this.
Err. F$#k?
Note namechecking every non-Apple CPU vendor and NVIDIA - but not mentioning AMD/Intel GPUs. Another note: Lots of small improvements, but not allowing users to move the Taskbar (to Microsoft, some things are important). Oh, and they haven't abandoned ReFS - so will it be available without Windows Professional for Enterprise etc.? I can't see many devs paying for that alone.
Now that would be pretty freaking cool!
I'm impressed with the progress.
I'm also scared about privacy of the data. How will that work with installing windows in business environments with sensitive IP?
>now with AI
Now you can actually talk to Big Brother!