The claim that this isn't a hard problem to solve seems very optimistic to me.
The tiny minority dominates the feeds because that's how the incentives for algorithmic driven social media are structured. Do we really expect Meta, X, TikTok to anything that could reduce engagement?
Good luck having any of the mainstream social media apps add the banner they propose.
The example in the post confirms my theory that for local models to succeed they need to be "good enough", not big enough that they can compete with frontier models.
They need to be able to do a small task well and they need to be able to run reasonably on consumer-class devices. Even better if they can run on mobile phones.
In my experiments with local LLMs I noticed that while increasing the size of the model is nice the real thing that turns a barely useless model into something useful is the ability to use tools.
Giving my models the ability to search the web and fetch web pages did way more to solve hallucinations than getting a bigger model. And it doesn't have a training cutoff.
Sure, the bigger model is probably better at using tools but I often find the smaller models to be good enough.
Will there even be a web to search in the future? These days public access blogs are dying and being replaced with hallucinated AI websites. Sites with original research like Reddit and YouTube are being locked up to prevent 3rd party indexing.
Knowledge and clean data sets are becoming increasingly valuable, and free community knowledge is drying up. The next big programming language won’t have years of Stack Overflow posts to train on.
Maybe we will see some kind of licensing deals where owners of good datasets charge you a fee to let your AI search them.
I'm not a fan of this being downloaded by default. Still, I very much prefer that, if something if Chrome uses a LLM, that's done via a local LLM rather than by via an API call
You need the regular gemma model as well. You can think of this as a really small distillation of the original. Useless by its own because it often is wrong, but it is fifth more than not. And because verifying a transformer model can be done faster than running it. We can effectively speed up by using this draft model and only doing the compute where it was wrong.
This is a oversimplification, but tldr you need both yes.
Every criticism levelled at the St. George's Cross can be levelled at the Union Jack. It is time people in England had a healthier relationship with their flag, more like Scotland and Wales, and less like Northern Ireland.
Every parish church in England (more or less) has flown the St. George's cross traditionally for as long as I can remember. There is nothing wrong with that. Conversely, Union Jacks are a major symbol of Loyalism and Orangeism in Ireland, and parts of Scotland, which is an extremely aggressive and "hands on" movement. Union Jacks can be seen in pictures of every far right movement going back a century or more.
The Union Jack is a symbol of empire and colonialism which the St. George's Cross isn't.
However, the football thing is more recent. If you watch "the Italian Job" from the 1960s, the England fans wave around Union Jacks instead of their own specific flag (as Scotland and Wales fans would). Clearly in the intervening years, England fans have discovered the England flag.
Scottish and Welsh people seem to be a lot more comfortable with their identity than English do. And that includes their flags. I have seen countless bits of research which suggest that ethnic minorities happily identify as Scottish and Welsh in Scotland and Wales, but in England, they identify as British rather than English. I suggest you read Billy Bragg's "the Progressive Patriot". He is an English socialist who has tried to reclaim English identity from the far right, which he is entitled to.
England has a unique position in the Union, and indeed much of the world, where it is seen as an historic and current oppressive force, and our attitude to flags has to acknowledge that context.
In Scotland, Wales and Northern Ireland the Union Flag is a reminder that the UK countries are ultimately run by England, where there isn’t a true acknowledgement that the countries are culturally different, let alone able to rule themselves.
Within England the St George’s Cross has become a symbol of exceptionalism and superiority, not least because it is prominently flown on nationalist and supremacist marches. Since the Union Jack includes the other countries in the Union, use of St George is often seen as a snub to the other countries.
So England can’t win? No. Correctly so, IMO, because of history and context (I am English).
I do not consider myself English, but Scottish. I remember ?fifteen years ago defending the St. George's Cross from English people arguing against it. The irony!
We do occasionally get billboards with company X saying they support England, but other than that it isn't an issue in Scotland.
Like Billy Bragg says, there is a strong case for reclaiming the English flag from the far right.
The Union Jack in Scotland has a much more complex history, particularly in and around Glasgow where it is connected with extreme loyalism and Orangeism (which is where a lot of the Scottish Reform party vote will come from.) In Northern Ireland, it is hated by a large section of the population. In Wales and Scotland, some independence supporters hate the Union Jack too.
The Union Jack has a strong association with the far right and loyalism, not to mention imperialism and somehow gets a free pass.
The Union Flag is much more of a right-wing symbol in Scotland, as you say (I lived in Scotland for 10 years) but in England the GC is far more associated with nationalism and the right, while the Union Flag is a bit more VE Day, church fetes and Cool Britannia, and gives more of a “working together” vibe than that of oppression.
Much of that is due to schooling and media conditioning, of course, but the flags mean different things to different people.
In Scotland it varies by region. In the north east and the borders, it is more innocuous although contentious. In the Central Belt around Edinburgh and Glasgow it is often linked with working class loyalism, when it's not on a hotel or a government building.
It was the flag of the British Empire with all that entails. It is to be found all over the loyalist areas of Northern Ireland and on Orange Marches. It has appeared in umpteen far right demos, and in fact if you look at 1970s far right footage you can see it is the flag they most commonly carry in the UK not the St. George's Cross.
Oh, and you'll find it at plenty of football matches, notably Glasgow Rangers, who fly it while singing songs about wanting to be "up to our knees in Fenian blood".
I use Vaultwarden because I need something cross-platform (macOS and Linux) and with support for passkeys.
The idea of using different storage methods for different categories of passwords is very interesting. Maybe I don’t need rbw (the rust reimplementation of bitwarden CLI) in my server and something simpler/different could do the job
Unlimited SMS isn't the solution. In fact most of the countries where Whatsapp is dominant already have unlimited SMS (probably because pretty much nobody is using it anymore).
What I'd like to see is interoperability so that I am not forced to use Whatsapp because everyone else is using it and my friends in the US aren't forced to buy an iPhone just to use iMessage
reply