For sake of doubt: No restaurant knows I’m coming. I choose the dishes and pay the full bill. I refuse any ‘extras’ I didn’t order which have been sent out for free.

Show Post

The funny part is you can use the hosted LLM to help you design & fit out the local hosted LLM. Pretty good guidance too.

Show Post

Worried about IP theft? Host your AI locally. Worried about cyber security & containment? Cool, build a physical sandbox.

Show Post

And the entire ponzi relies on expensive ram in expensive data centres in expensive LLM all hosted in a nice ever increasing price platform. Give the option of making this happen on a few desktop PCs in a building? Well. That’s large numbers of value business case gone from those data centres

Show Post

Truly, the capacity to setup localised LLM would be the renaissance for tech, and the end of the big monopoly. Small business could cut its ties with large SAAS & hosting. The models would be inverted pyramid type things.

Show Post