Open models exclusively on hardware I own... despite my employer both demanding 'the frontier' and providing unlimited spend/quota. Two main points:
1: primarily for repetitive/arduous things I'm not concerned with outsourcing. Editor features on steroids, basically.
2: testing how my lack of *tracked* token usage, but still delivering, is handled by the powers that be.
To get us on the lab gravy train, we were told results matter and how the thing is made doesn't; we'll see. Not left behind yet :)
Subscribed, swe, for dev. I could probably optimize local models and a custom harness to get much of the same outputs locally but it’s easier to throw something at Opus 5.5 & one shot it.
I'm using locally so that I can test it for my project without paying per token(if I use it from hugging face). I exhausted free limit in just 5-7 hrs of testing when I used hugging face api.
10 comments