Hacker Newsnew | past | comments | ask | show | jobs | submit | k__'s commentslogin

Why doesn't Mistral distill?


Good question, given that American companies basically threw copyright law into the trash, I think they should.


American companies can't sur Chinese ones, but they can do it with European ones.

So then the European ones should join with European copyright holders to sue OpenAI/Anthropic and watch them trying to BS their way around what they train on.

Training a model on copyrighted material is fair use and copyright holders already operate a mafia-style extortion ring in Europe, so I don't think that's a good idea.

> Training a model on copyrighted material is fair use

I am not sure this has been actually established, but I don't see how distilling a model is not fair use then.


American companies won't even sue other American companies (xai distilling opus), in fact they instead form partnerships ;)

Well if they did wouldn't be able to feel superior to Americans about that particular thing. Perish the thought!


It’s really a pity, why can’t they feel superior while breaking ToS and copyrights just like Americans can feel superior over Deepseek while breaking ToS and copyrights?

I tried it with embedded programming, and failed miserably.


You? Or it? Or you together?

Srsly. Welcome to my day job. I can see that the LLMs' center of training is so far off from where I'd need it, I can accelerate auxillary stuff but prompt never beats the weights and it constantly pulls back into it's middle...


200ml every waking hour?

Seems excessive.


I have a bottle of 2.5liters. One bottle of water everyday from 7am to 8pm. It’s my habit for several years.


it's a matter of habit. 3l of liquids per day is what various doctors in different (european) countries have recommended me over the years.


Are we sure this is not just harmless and arbitrary information being parroted? Do we have verifiable sources other that anecdote? I find it hard to believe that there is just a single value for water intake across the massive biological spectrum that is humanity and expect to see a range when this conversation comes up. You're also getting water from foods, which I am sure is not being accounted for. Reminds me of the 10k steps a day that just happened to be "correct enough" to be believed and acted on. The truth is much more nuanced and depends on a number of factors in a person's physical health.

Without concrete verifiable findings, the best we can do is learn to pay attention to our bodies and drink maybe a little bit more water than we think we need to.


Overdrinking water is an American mania. You don't need to drink 3 liters.

https://abcnews.com/Health/Wellness/waterlogged-america-drin...

The European doctor quoted certainly said "3 liters" from both drinks and food (especially vegetables). In Europe I think we drink between 1 and 2 liters per day in actual water, depending on how dry the weather is.


Agreed. Being in the Midwest US, my intake also varies widely, depending on weather or season, physical activity, and the foods I've been eating.

I'm not entirely dismissive of doctors, be they European or American, as most I've encountered do have the patient's best interest at heart. But they are also human, and it is very easy to stick with the safe and easy answer rather than do the work to find the real answer. So when I hear claims like that, I immediately doubt them, assuming it is placeholder information because we do not know the actual answer. Unfortunately, a lot of our media in the US considers such "placeholder information" to be actionable, and ends up convincing the public (including doctors) of its veracity.



I always laugh about those ridiculously large water bottles American carry and how they remind you all the time that you must drink water as if I did need it. I wonder why that happens.


Americans don't eat vegetables though


They also eat plenty of salty processed foods.


Which helps with water retention, so...



sure, there are different recommended amounts, the EFSA recommendations are 2.5l per day for a grown up man and 2l for a woman[0]. I'm a bit bigger than the average so I got 3l as a recommendation when I was on a diet or when I had specific issues.

But I didn't mean to imply everyone should drink it, just that it's not hard to drink that much. And yes, of course you ingest a lot of water through other means too.

[0] https://efsa.onlinelibrary.wiley.com/doi/10.2903/j.efsa.2010...


I’ve always been extremely suspicious of constant water consumption. No other mammal seems to do this. Even the ones that require a lot of water like horses will only drink when they’re thirsty or while eating.


The point is you shouldn’t wait to drink until you feel thirty. That’s too late. Your muscle has been consumed by then.


Its aggravated because the "water sensor" appears to fail early with age. Elderly people tend to not get the thisty feeling as often, but get dehydrated anyway.


Indeed. That’s why I form the habit to drink 3 liters everyday to keep my urine white transparent.


I wonder how much of the effects of ageing are due to cascading failures downstream of alterations like these. For example, it's common for people to lose teeth in advanced ages. How much of this is due to dry mouths from insufficient water intake? Fallen teeth then may become entry points for infections, et cetera. Perhaps fixing a few early causes we can avoid a lot of negative effects and live more, without the need to go full spartan in lifestyle discipline.


I don’t know the exact things. I only know that diabetes would make this loss tremendously. As to teeth loss, it’s mainly because periodontitis but not age though it always goes worse as the age increases because of their life behaviors.


No other mammal eats cooked or baked food. Raw meat or raw plant contain more water than our food.


Most other animals have typical lifespans that don't top two decades.


Tl;Dr blame Gatorade marketing.

The book "waterlogged" does a good takedown of the myth. Basically only you need to drink when you are thirsty.


It’s a glass of water an hour. Hardly excessive.


It doesn't do anything to drink so much water. It is a purely American myth/trend.

https://abcnews.com/Health/Wellness/waterlogged-america-drin...


I feel much better when I drink more water: head, eyes, and body. And if I don't drink enough water during the day I'll cramp at night. Drinking lots of water to lose weight is nonsense – on this I agree.


I bet that your body needs more water if you eat ungodly amounts of salty processed food, just to flush all that shit out again.


A few big sips.


Why


So, this basically ensures that models call the right tools with the correct format?


In a nutshell, yes. It tries to anyways, but at the end of the day, some models get stuck and you hit a max iterations error that forge will raise, with some context, and the consumer can choose what it wants to do at that point.


Ah, so it a "smart" retry mechanism?


I'd like to think so! ;). It has some brains, but the key insight was to send the model domain-agnostic nudges. I don't need to know what you're trying to do, the LLM already knows, I just need to nudge it back on the structural side: text response vs tool call, arg mismatch, etc. and let its knowledge of the context fill in the blanks (otherwise I'd need a massive library of every possible failure mode).

The other insight was doing it at tool call level and not workflow level, which addresses the compounding math problem more directly.


Maybe similar to Instructor [1] which was a cool tool for json and structured output enforcement combining pydandic with ai retry loops very handy for when models don't have that covered

[1] https://github.com/567-labs/instructor


Interesting! I'll look into that. Would mean another dep/integration but might be more robust.


This.

Directors of small companies are the same, they're just not wealthy enough that they could do any harm.


Anti-intellectualism is at it again, hu?


Probably less issues with account management and rate limits.


I'd say, on averaged, it's 50% what you say and 50% communication issues.

Most smart juniors have no problem with learning. Perceptual exposure and deliberate practice works almost mechanically. However, if someone can't tell you what examples you should be exposed to, you'll learn crap.


Has this ever happened before?


This is the story imo. For a large percent of people, basically everyone born after 1980, technology has always reduced in price and increased in capabilities over their entire life. If sustained, which if you start with the Xbox price increase it probably already is, this is a secular change in the market for technology.


PlayStation 5 has a price increase in August, 2022. I think this was the very first time this happened.

Xbox Series X had one in June, 2023.

Nintendo Switch (original) had a price increase last year.

I don't remember this ever happening before the 2020s unless it was due to retailer shortages or markups.


NEC temporarily raised the price of the TurboExpress due to low screen yields in 1991. That is the only price increase I was able to find.


I was wondering the same thing - I grew up thinking of console prices as something that invariably fell over time


Ram prices went up, normally they go down.


Yeah, given everything I'm not entirely surprised - I'm just curious if this is literally the first time a console has gone up in price post-release, or if I just wasn't paying attention the other times.


At my new job, I was assigned to improve processes with AI.

My first thought was, well agents seem nice, but I think, AI workflows are a better bet. However, I don't really understood AI or agents in depth and felt like I was just "doing things the old way" and removing flexibility from agents was a ridiculous idea.

After some research I got the impression that I was right. A well defined workflow and scope is just what's needed for AI. It's cheaper and more consistent. It probably even makes the whole thing run well with non-SOTA models.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: