You can also run Llama 405B and the latest (huge) DeepSeek on your own hardware ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		evilduck on Jan 7, 2025 \| parent \| context \| favorite \| on: How I program with LLMs You can also run Llama 405B and the latest (huge) DeepSeek on your own hardware and get LLMs that trade blows with Claude and ChatGPT, while being fully isolated and offline if needed.

krembo on Jan 7, 2025 [–]

With Amazon Bedrock you can get an isolated serverless Claude or llama with a few clicks

evilduck on Jan 8, 2025 | [–]

True, but if your org is super paranoid about data exfiltration you're probably not sending it to AWS either.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact