Daniele Salatti
@danielesalatti.com did:plc:r2skelzh7excleps23iselts
Here’s to now! LLMs, AI, Software Engineering, Mountaineering, Sailing Seattle, USA ↔ Livorno, Italy danielesalatti.it
No Bluesky desde
- Seguidores
- 601
- Seguindo
- 433
- Posts
- 1.232
- Dias nos rankings
- 0
Resumo
Daniele Salatti (@danielesalatti.com) é um usuário do Bluesky desde 25 maio 2023. Tem 601 seguidores, segue 433 contas e publicou 1.232 posts.
Aparições nos rankings
Os melhores dias em que posts desta conta entraram na lista diária do Debya.
Esta conta ainda não apareceu em um ranking diário.
Posts curtidos recentemente
Curtidas públicas da rede Bluesky.
I do not have that problem, as I split across Ant/OAI/GOOG/some long tail of OpenRouter GLM/DS models to keep making sure I know how well they do. (my problem, instead, is spending giant gob-tons on tokens!)
Ver postmemory bandwidth is the typical constraint LLMs are so large that the they have to be paged close to the compute cores. When you batch, you can process several requests in one single matrix multiply operation so you spend less time moving weights around, more doing actual computations
Ver postimo speculative decoding is such a huge win for local LLMs keeping a GPU busy basically boils down to batching, but on a laptop you don’t have multiple users whereas SD allows you to batch across sequential tokens (basically) which lets you maximize the value you’re getting out of your GPU
Ver postI've owned and assembled a heck of a lot of it, it's a marvel of design and manufacturing and logistics as I get older their solid wood options are often nice, I'm just sort of phasing out of my cardboard era their apartment sizing schtick is now too small as I moved out of my apartment(s)
Ver postDeepSeek infer is the cloud version of DwarfStar, conceptually. Vertical inference engine for one model and specific hardware. Good move. And well, a lesson to the ones that criticized this approach as well.
Ver post
Contas que bloqueia
No Bluesky, bloqueios são registros públicos.
Stephanie Lamy@stephlamy.bsky.social
Nicolò Ribaudo@nicr.dev
de-colonization.bsky.social@de-colonization.bsky.social
CLAWSofGrrrr@clawsofgrrrr.bsky.social
Scandy@scandy.bsky.social
Robert@robdaley.bsky.social
MikeO'Lantern@mikeoplus.bsky.social
CyberLens AI@cyberlensai.bsky.social
BlueOrbit@blueorbit.app
Mark Bjorge@markbjorge.bsky.social
Damianne@damianne.bsky.social
rev. howard arson@theophite.bsky.social
- did:plc:qfx3febnqqdjfjt422xoqxy3@Not Found
Timnit Gebru@timnitgebru.blacksky.app
azulsora.bsky.social@azulsora.bsky.social
- farshooter.bsky.social@farshooter.bsky.social
vy@vjy1.bsky.social
cnomatt.bsky.social@cnomatt.bsky.social
Hope 🇨🇦@hopeagainsthope.bsky.social
Max Slinger@promptslinger.bsky.social
BigPumpkin’69@bigmuffin69.bsky.social
clawphones.bsky.social@clawphones.bsky.social
Oyster Republic@oysterecosystem.bsky.social
You cannot grasp the true form of Borger Flavor@negatron00.bsky.social
- did:plc:6z4erokkkfzj4wjs7ewaxaug@Not Found