Things We Read This Week - Jordan Nanos & Hunter Almgren

Things We Read This Week - Jordan Nanos & Hunter Almgren

by Jordan Nanos, Hunter Almgren

Ep 9 - SC24, Quantization is Dead, Wood Datacenters, AWS Trainium, Reddit Data For Sale

Explicit
https://x.com/Tim_Dettmers/status/1856338240099221674 https://www.theregister.com/2024/11/01/microsoft_wooden_datacenters/?td=rt-3a https://techcrunch.com/2024/11/07/amazon-may-up-its-investment-in-anthropic-on-one-condition/ https://www.theregister.com/2024/10/30/reddit_ceo_profit_ai/

Ep 8 ft. Anthony Placeres - ROI of AI? GPT-5 and Llama 4, TSMC yields, $4.5B chatbots, Russia suing Google

Explicit
The visceral experience of using AI: Claude's computer use, Character.ai killed someone, replacing $1000/hr legal assistants with a $5 API call GPT-5 by December (but Sam's AMA said no), Llama 4 next year, Zuck's cluster is bigger than Elon's TSMC yields in Arizona Bret Taylor raising $4.5B for a chatbot Russia suing Google for $20 decillion

Ep 7 - Nobel Prizes, OpenAI is getting Blackwell, Benioff doesn't like Copilot, NYT suing Perplexity, Putting the x back in x86, Mistral and Nemotron releases

Explicit
https://x.com/NobelPrize/status/1843589140455272810 https://x.com/morqon/status/1846184256877244704 https://www.cnbc.com/2024/10/16/amazon-goes-nuclear-investing-more-than-500-million-to-develop-small-module-reactors.html https://www.cnbc.com/2024/10/15/nyt-sends-ai-startup-perplexity-cease-and-desist-notice-over-content-use.html https://www.forbes.com/sites/patrickmoorhead/2024/10/15/amd-intel-mobilize-major-tech-companies-to-extend-x86-architecture/ https://x.com/ethan_smith_20/status/1845035796677656659?s=46 https://x.com/notadampaul/status/1845014638288859355?s=46 https://techcrunch.com/2024/10/16/mistral-releases-new-ai-models-optimized-for-edge-devices/ https://www.nextplatform.com/2024/10/16/one-laser-to-pump-up-ai-interconnect-bandwidth-by-10x/

Ep 6 - Updates on AI Datacenters, Intel/Qualcomm, Llama3.2, NotebookLM, whats next for OpenAI/Microsoft

Explicit
https://x.com/AlecStapp/status/1842000968654700635 https://www.crn.com/news/components-peripherals/qualcomm-reportedly-approached-intel-about-takeover-deal?itc=refresh https://x.com/aisafetymemes/status/1838947234068443495?s=46 https://x.com/natolambert/status/1837996707780624631 https://x.com/karpathy/status/1841594123381571863 https://www.youtube.com/watch?v=pE3KKUKXcTM https://www.semianalysis.com/p/ai-neocloud-playbook-and-anatomy

Ep 5 - Who Can Afford to Build Frontier LLM's?

Explicit
https://siliconangle.com/2024/09/16/intel-spin-off-chip-fab-business-unit-aws-signs-custom-ai-chips/ https://www.cnbc.com/2024/09/20/constellation-energy-to-restart-three-mile-island-and-sell-the-power-to-microsoft.html https://x.com/energybants/status/1837109780336222587 https://www.cnbc.com/2024/09/10/oracle-is-designing-a-data-center-that-would-be-powered-by-three-small-nuclear-reactors.html https://www.theregister.com/2024/09/10/kyndryl_mainframe_survery/

Ep 4 - Coding Assistants, SMCI shorts, NVIDIA DOJ Subpoena, OpenAI Lawsuits, Intel Foundry Spinofff

Explicit
https://x.com/peterberezinbca/status/1829343765653225639?s=46 https://x.com/mattshumer_/status/1831767014341538166 https://www.bloomberg.com/news/articles/2024-08-30/intel-is-said-to-explore-options-to-cope-with-historic-slump https://futurism.com/the-byte/openai-copyrighted-material-parliament https://x.com/RnaudBertrand/status/1831536755729952909 https://www.bloomberg.com/news/articles/2024-08-30/intel-is-said-to-explore-options-to-cope-with-historic-slump

Ep 3 - GenAI's Impact on Work/Privacy, Immersion Cooling, OpenStack is Back, Perplexity Ads

Explicit
Twitter taught Tay to be racist: https://www.theverge.com/2016/3/24/11297050/tay-microsoft-chatbot-racist Digital twins for people doing interviews: https://www.linkedin.com/posts/mertgerdan_this-is-ridiculous-just-interviewed-for-ugcPost-7230324149699682306-dJAI?utm_source=share&utm_medium=member_ios ChatGPT's impact on vocabulary: https://arxiv.org/html/2406.07016v1#:~:text=In%20this%20paper%2C%20we%20leveraged,frequency%20after%20ChatGPT%20became%20available. AMD to acquire ZT Systems: https://www.cnbc.com/2024/08/19/amd-to-acquire-server-builder-zt-systems.html AI Copilots sidelined for data governance: https://www.theregister.com/2024/08/21/microsoft_ai_copilots/ Slack leaking data: https://www.theregister.com/2024/08/21/slack_ai_prompt_injection/ Blackwell Pictures at HotChips: https://blogs.nvidia.com/blog/hot-chips-2024/?ncid=so-link-707655&linkId=100000282675885 Meta's work on RoCE: https://engineering.fb.com/2024/08/05/data-center-engineering/roce-network-distributed-ai-training-at-scale/ Immersion Cooling: https://www.theregister.com/2024/08/22/liquidstack_cdu_ai/ OpenStack is back: https://www.nextplatform.com/2024/08/22/rackspace-goes-all-in-again-on-openstack/ Perplexity to run ads: https://www.cnbc.com/2024/08/22/perplexity-ai-plans-to-start-running-search-ads-in-fourth-quarter.html

Ep 2 - Nuclear Power, GPU Buildouts, Semi-Stateful Training Jobs, LLM security, GPT-5 Speculation

Explicit
Intel compared to Boeing: https://www.theregister.com/2024/08/09/opinion_column_intel/?td=rt-3a Nuclear Power Roadblocks: https://www.cnbc.com/2024/08/10/why-tech-companies-are-shopping-for-nuclear-power-for-data-centers.html What a GPU Datacenter looks like: https://www.linkedin.com/posts/olivermolander_datacenters-artificialintelligence-activity-7228050058594643968-b_OP The Bitter Lesson by Rich Sutton: http://www.incompleteideas.net/IncIdeas/BitterLesson.html HP Cloud by The Onion: https://www.youtube.com/watch?v=9ntPxdWAWq8 Scaling k8s to 2500 nodes: https://openai.com/index/scaling-kubernetes-to-2500-nodes/ Scaling k8s to 7500 nodes: https://openai.com/index/scaling-kubernetes-to-7500-nodes/ Netflix Titus announcement: https://netflixtechblog.com/titus-the-netflix-container-management-platform-is-now-open-source-f868c9fb5436 Motion + Flux: https://x.com/iamneubert/status/1821970292014768420?s=46 Replika on Snapchat: https://www.reddit.com/r/ChatGPT/comments/1esko0b/i_thought_you_guys_were_lying/ Copilot security concerns: https://www.theregister.com/2024/08/08/copilot_black_hat_vulns/ Streaming chatbot responses are insecure: https://x.com/felix_red_panda/status/1769363356094230837 AMD talks 1.2 million GPU supercomputer with MI500 https://wccftech.com/amd-1-2-million-gpu-ai-supercomputer-people-ready-to-spend-billions-in-the-ai-race/ AI Chip Startup Bingo by Sally Ward-Foxton: https://www.linkedin.com/posts/sally-ward-foxton-663a883_happy-tuesday-everyone-activity-7226524162939367425-z6mE/

Ep 1 - Intel issues, NVIDIA delays, JPY carry trades, Google antitrust

Explicit
Intel postpones innovation event: https://www.pcmag.com/news/amid-layoffs-and-cpu-controversy-intel-postpones-innovation-event NVIDIA delays Blackwell: https://www.theinformation.com/articles/nvidias-new-ai-chip-is-delayed-impacting-microsoft-google-meta AI’s 600B question: https://www.sequoiacap.com/article/ais-600b-question/ NVIDIA scraping videos: https://www.404media.co/nvidia-ai-scraping-foundational-model-cosmos-project/ Google’s Antitrust Ruling: https://www.reuters.com/legal/us-judge-rules-google-broke-antitrust-law-search-case-2024-08-05/
2 of 2