Isn't the Bahdanau attention even earlier[0]?

[0] https://arxiv.org/abs/1409.0473

It looks like this is an SaaS with an open source client only right?

Moreover, some of the models used as listed at https://faim.it.com/models are open models developed by third-parties, and how you host and call them is up to you.

And that copying was largely enabled by our greedy western bean counters that outsourced so many things in the first place.

Which in turn was fueled by the consumers' desire for cheap stuff, and for their portfolios to earn them a lot of money to be able to retire early and live comfortably while letting a cheaper workforce far away do more and more of the dirty and dangerous jobs.

The "bean counters" are under pressure just like everybody else. They didn't come up with their targets and incentives out of nowhere.

That's what happens when wages are relatively stagnant compared to increases in productivity.

That's a fair point! I am myself wondering how much of this is policy and how much is the "natural way".

To be fair, they were uncoordinated actors in a prisoner’s dilemma competition.

This was the role of government to manage but there weren’t enough non-lawyers at positions of power to understand fixes.

Now with the massive fraud seen in local states, civilians will rightfully trust institutions less and the downward trend will continue.

Cool!

The viable alternative is to stop watching all the crappy content you don't need anyway. Their restriction to 3 videos for people with ad blocker was a wake up call for me, helping me realize how much content I consume from youtube that not I only don't have a need for, but is actively occupying a sizable portion of my mind. I am old enough to remember the world without youtube, when you could read a book, talk to people, do sports etc, without staring at the screen mindlessly. A 30 min video might not look like much, but that is the equivalent of a decent stretching workout, drinking a cup of tea while relaxing or a multitude of other activities that will actually help you become happier and healthier.

Thank you youtube for helping me realize how harmful you really are!

How does it compare to e.g. Eastern Europe? What is the typical salary of a senior developer or architect in NZ?

Depending on skillset $150k-$230k is common. You do have to balance this against the cost of living though, we definitely don’t have Eastern Europe’s cost of living advantage.

Assuming $ is NZD and you are quoting net, yearly income, then it is 1.5-2.5 times higher than Eastern Europe wages according to statistics in my environment. Unfortunately, cost of living has increased substantially here as well. For example, a decent (but not spacious) 2-bedroom apartment is in the range of EUR 300k-500k already.

That’s gross yearly income, after tax it’s $125k. Though for a lot of people there aren’t many other expenses after tax, just rent and food.

A decent 2 bedroom apartment in Auckland or Wellington will set you back $800k-$1.2M based on a quick look at the market. It can be a lot cheaper away from the cities.

Food however is expensive.

That's contracting rate and not sure how common anymore.

That’s full time employment and pretty common with the people I asked for architect-equivalent positions.

I think it is not so much about capitalism, but about the coupling of democracy with money. Money -> Media/Influencers -> election -> corruption -> go back to 1. To make a meaningful change, the society must somehow decouple democracy from money. With current technology it shall be possible to vote directly for many things instead of relying on (corrupt, pre-bread) representatives. Something like democracy 2.0 :)

True, but the main reason for success here, as far as I understand, is that drones were launched very close to the airfield.

It is not a method to compress a Grouped-Query Attention model, but to expand it into an equivalent Multi-head Latent Attention model with the same key-value cache size but larger effective key/value vectors and a correspondingly larger number of trainable parameters. With additional training, you can then obtain a better model that only uses a little bit more memory.

Thanks for the clarification.

Also makes models smarter ("expressive")

I am working on the sunflower plant density estimation problem. The goal is to be able to estimate the germination rate as early as possible. Farmers benefit from such information, because:

- there are lots of expenses still to be made (fertilizer, pesticide, salaries), which may not be worth it if germination is under certain threshold

- if detected early, there is still time to plant another grain or to fill up the missing plants (requires precision seeders and seeding maps)

- is a very good proxy for yield estimation (farmers often trade futures even before they have harvested)

For the purpose I have created a dataset (a collaboration between my employer and Sofia University) and published it in order to enable scientific collaboration with other interested parties. Still working on the dataset annotations.

https://huggingface.co/datasets/su-fmi/sunflower-density-est...

Interesting, I'm also involved in a project to do yield prediction, but with a ground-vehicle with camera's on top to drive between strawberry and blueberry plants.

Yield prediction is huge indeed, because overshooting your prediction means seller stuff for a lower price. Undershooting means paying for someone's product to make up for the difference. Probably there's quite a bit of matchmaking in between those under and overshooters and someone making a good buck out of that too.

> Undershooting means paying for someone's product to make up for the difference

Indeed. Making up the difference can easily eat most of the farmer's profits. I guess it is even more pronounced for berries when compared to grains, because they cannot be stored for so long.

Hey, this is interesting. I used to work on a somewhat similar problem. Our problem was more general, but one usecase is to predict the number of interactions between flowers and pollinators, given some initial counts. As these initial counts are obtained manually (by going to the fields, taking pictures and count, like number of bees within a frame), those count numbers are likely to be lower the the actual numbers. We addressed this under-counted issue using low-rankness and Poisson mixture model. Take a look if you're interested: https://ieeexplore.ieee.org/document/10888717

Interesting. Thanks!

Feel like this basically enabling the use of ANOVA? (Compares yields across different treatments (e.g., irrigation methods, seed types).

It is possible. However, getting accurate yield data requires a "smart" harvester that can produce yield maps. Many modern harvesters are equipped with GPS and various sensors, so it is possible. However, farmers are really slow to replace old equipment if it works fine. I guess there are some retrofit solutions for yield mapping, but I haven't investigated their affordability and penetration into the (EU) farming landscape yet. Additionally, there are other interesting parameters apart from the harvested quantity that can be captured (e.g. the quality of the grain itself, such as size, composition, humidity etc).

Fisher invented ANOVA specifically for analyzing crop yields so it's a natural fit.

However for precision agriculture kavalg might want to consider other methods.

Very cool, what type of parameters are within your control if detected early?

I am not sure that I understand your question correctly, but given more precise sunflower density estimation, the farmer has three options:

1. Plow the field and seed again (same or different variety or grain). This is a very crude measure, but it is sometimes the right thing to do, because as I said most of the expenses have not been realized yet (fertilizer, pesticide, fuel, payroll, paying rent for the land). It is also a time critical decision, because the window of opportunity for plowing and reseeding is not very wide.

2. Accept the lower yield if it is within a reasonable margin (e.g. comparable to the expenses to plow and reseed).

3. Do partial reseeding over the existing plants (without plowing). This is an emerging strategy with the proliferation of smart seeders, but it requires a precise seeding map to be created beforehand (i.e. based on the density estimate). As an advantage, you spare the expenses for seeds and plowing, however there is some disadvantage as well, due to the different rate of development of the newly seeded plants. Farmers usually need plants to be ready for harvest at the same time, otherwise the quality of the grains suffers and hence the selling price is lower.

In addition to these points, having precise density information after germination helps with the identification of problems, such as seeder malfunction (e.g. nozzles getting clogged), seed quality and meteo data (e.g. too much rain, low temperatures etc).

Do sunflower farmers not use fertilizers, pesticides, or irrigation?

In the EU they use fertilizers and pesticides, but rarely use irrigation. However, pesticides are usually applied over the lifecycle of the plants. For fertilizer, there is some value to apply it on time, because it tends to migrate with water and applying now vs a month ago is not equivalent.