This is the big one for me. I recently needed to solve a fairly simple issue; in 3 days I had a solution in FastAPI and SQLAlchemy working with a React front end. Under 1,000 lines of code between the two.
Of course we can’t spend $20/month on compute for that, so it’s now a web hook jankily jammed into another app that writes data to Jira with an Airflow job that triggers Databricks to run a notebook that uses Spark to write the data to S3.
All that to replace a Lambda that would never have gotten to triple digit queries per day. No, instead we spent a month of engineering time to strap all this together and we probably spend 4x as much on compute because it is both slower and requires more resources.
And now I’m getting complaints that it’s complicated and hard to troubleshoot. Yeah, of course, we’ve duct taped together products whose combined manuals are thousands of pages. Color me shocked it’s hard to use.
Of course we can’t spend $20/month on compute for that, so it’s now a web hook jankily jammed into another app that writes data to Jira with an Airflow job that triggers Databricks to run a notebook that uses Spark to write the data to S3.
All that to replace a Lambda that would never have gotten to triple digit queries per day. No, instead we spent a month of engineering time to strap all this together and we probably spend 4x as much on compute because it is both slower and requires more resources.
And now I’m getting complaints that it’s complicated and hard to troubleshoot. Yeah, of course, we’ve duct taped together products whose combined manuals are thousands of pages. Color me shocked it’s hard to use.