Scaling Knowledge is a blog and podcast about progress, epistemology, and AI. more at https://scalingknowledge.substack.com/about

Scaling Knowledge
Claim This Podcastby Moritz Wallawitsch
Podcast Overview
Scaling Knowledge is a blog and podcast about progress, epistemology, and AI. more at https://scalingknowledge.substack.com/about
Language
🇺🇲
Publishing Since
9/17/2022
1 verified contact email on file for Scaling Knowledge
Pitch yourself as a guest, propose sponsorships, or reach out directly to the host.
Recent Episodes

July 23, 2023
AI, Airships, Knowledge Retrieval, & More w/ Anton Troynikov, Founder @ Chroma
<p><strong>Anton</strong> on Twitter: <a href="https://twitter.com/atroyn" target="_blank" rel="noopener noreferer">https://twitter.com/atroyn</a></p> <p><strong>Moritz</strong> on Twitter: <a href="https://twitter.com/MoritzW42" target="_blank" rel="noopener noreferer">https://twitter.com/MoritzW42</a></p> <p>Scaling Knowledge: <a href="https://scalingknowledge.substack.com/" target="_blank" rel="noopener noreferer">https://scalingknowledge.substack.com</a></p> <p><br></p> <p><strong>Mentioned Resources</strong></p> <ul> <li>Unlimiformer: Long-Range Transformers with Unlimited Length Input: <a href="arxiv.org/abs/2305.01625" target="_blank" rel="noopener noreferer">arxiv.org/abs/2305.01625</a></li> <li>Memorizing Transformers: <a href="arxiv.org/abs/2203.08913" target="_blank" rel="noopener noreferer">arxiv.org/abs/2203.08913</a></li> <li>Chroma: <a href="https://www.trychroma.com/" target="_blank" rel="noopener noreferer">https://www.trychroma.com</a></li> <li>You and your Research: <a href="https://www.cs.virginia.edu/~robins/YouAndYourResearch.html" target="_blank" rel="noopener noreferer">https://www.cs.virginia.edu/~robins/YouAndYourResearch.html</a></li> <li>Against Method: <a href="https://en.wikipedia.org/wiki/Against_Method" target="_blank" rel="noopener noreferer">https://en.wikipedia.org/wiki/Against_Method</a></li> </ul> <p><br></p> <p><strong>Contents</strong>: </p> <p>(00:00) Preview </p> <p>(01:14) Introduction </p> <p>(06:13) Edech </p> <p>(12:12) Airchips cost structure </p> <p>(24:06) Techno Optimism </p> <p>(25:09) Convenience vs Enabling Technology </p> <p>(31:13) Chroma and LLM Landscape </p> <p>(35:37) Minecraft Bot </p> <p>(37:05) Knowledge Retrieval </p> <p>(39:38) New Knowledge Retrieval Research and Techniques: (Direct Retrieval Augmentation of Transformers, Conditional Retrieval) </p> <p>(42:35) AI Native Platforms </p> <p>(45:43) Theorem Proving and Generation </p> <p>(49:40) Do LLMs Reason </p> <p>(52:18) Computational Complexity and LessWrong </p> <p>(53:58) Frameworks and Taking Your Work Seriously</p> <p>(55:53) Job Displacement and Jobs Supply vs Demand Side </p> <p>(58:29) The Printing Press</p>

July 22, 2023
The Myth of Artificial Intelligence with Erik J. Larson
<p><strong>Twitter</strong>: <a href="https://twitter.com/MoritzW42/" target="_blank" rel="noopener noreferer">Moritz (@moritzW42)</a></p> <p><strong>Blog</strong>: <a href="https://scalingknowledge.substack.com" target="_blank" rel="noopener noreferer">https://scalingknowledge.substack.com</a></p> <p>----</p> <p><strong>About Erik</strong>: <a href="https://en.wikipedia.org/wiki/Erik_J._Larson" target="_blank" rel="noopener noreferer">https://en.wikipedia.org/wiki/Erik_J._Larson</a></p> <p><strong>Erik's book</strong>: <a href=" https://www.amazon.com/Myth-Artificial-Intelligence-Computers-Think/dp/0674983513" target="_blank" rel="noopener noreferer">https://www.amazon.com/Myth-Artificial-Intelligence-Computers-Think/dp/0674983513</a></p> <p><strong>Transcript</strong>: <a href="https://scalingknowledge.substack.com/i/135360356/transcript-rawapproximation" target="_blank" rel="noopener noreferer">https://scalingknowledge.substack.com/i/135360356/transcript-rawapproximation</a></p> <p>----</p> <p><strong>Content</strong></p> <p>(00:00) Preview</p> <p>(01:33) Intro</p> <p>(06:55) Unpredictability of Invention</p> <p>(10:09) Limits of Deep learning progress</p> <p>(12:59) Abduction</p> <p>(16:45) Creativity and Serendipity</p> <p>(19:16) Neumann on Self Improving Machines</p> <p>(24:30) His upcoming book</p> <p>(26:40) Progress & Innovation decentralisation</p> <p>(28:21) Neurosymbolic AI</p> <p>(30:29) AI research progress</p> <p>(33:16) Automation, Displament, and Alienation</p> <p>(34:58) Outro</p>

July 14, 2023
The Almanack of Keith Rabois
<p>Created with <a href="https://www.wondercraft.ai/" target="_blank" rel="noopener noreferer">wondercraft.ai</a> (get 50% off with SCALINGKNOWLEDGE50)</p> <p><br></p> <p><strong>Keith Rabois</strong></p> <ul> <li>Twitter: <a href="https://twitter.com/rabois" target="_blank" rel="noopener noreferer">twitter.com/rabois</a></li> <li>Wikipedia: <a href="https://en.wikipedia.org/wiki/Keith_Rabois" target="_blank" rel="noopener noreferer">wikipedia.org/wiki/Keith_Rabois</a></li> </ul> <p><strong>Mo Golshan</strong></p> <ul> <li><a href="https://mogolshan.notion.site/Lessons-from-Keith-Rabois-2b867858346448998d23f51beee3470a" target="_blank" rel="noopener noreferer">OG written content version</a></li> <li>Mo's twitter: <a href="https://twitter.com/mogolshan" target="_blank" rel="noopener noreferer">twitter.com/mogolshan</a></li> </ul> <p><br></p> <p><strong>Mentioned links:</strong></p> <ul> <li>Interview with John Sculley on Apple and Steve Jobs: <a href="http://www.cultofmac.com/john-sculley-on-steve-jobs-the-full-interview-transcript/63295">John Sculley On Steve Jobs, The Full Interview Transcript | Cult of Mac</a> </li> </ul> <ul> <li>Read The Cognitive Style of PowerPoint by Edward Tufte: <a href="http://www.edwardtufte.com/tufte/powerpoint">http://www.edwardtufte.com/tufte/powerpoint</a> </li> </ul> <ul> <li>Achieving Business Success One Person at a Time* by Peter Engel: <a href="http://www.amazon.com/Exceptional-Individual-Peter-Engel/dp/0312182384/ref=sr_1_6?ie=UTF8&s=books&qid=1269995065&sr=8-6">The Exceptional Individual: Achieving Business Success One Person at a Time by Engel, Peter</a></li> </ul> <ul> <li>Advisory board: <a href="http://www.bothsidesofthetable.com/2009/10/12/should-your-startup-have-an-advisory-board/">Should Your Startup Have an Advisory Board? | by Mark Suster | Both Sides of the Table</a> </li> </ul> <ul> <li>Essay on hiring great PMs: <a href="http://www.kennethnorton.com/essays/productmanager.html">How to Hire a Product Manager: the Classic Essay by Ken Norton</a> </li> <li>What is more important for a start-up: quality of team or size of market? <a href="http://pmarca-archive.posterous.com/the-pmarca-guide-to-startups-part-4-the-only">pmarca archive.posterous.com/the pmarca guide to startups part 4</a></li> <li>How to Raise money before launch? <a href="https://medium.com%2F@medium.com/@zebulgar/how-to-raise-money-before-launch-a3544ef4dba6">How to raise money before launch. by Delian Asparouhov</a></li> <li>Should a student finish college or go work for a startup if given the chance to work for a YC, TechStars alumni? <a href="http://paulgraham.com/mit.html">A Student's Guide to Startups</a> </li> </ul> <p><br></p> <p><strong>Content:</strong></p> <p>(00:00): Intro</p> <p>(01:00): Navigating the Ambitious Problem-Solving Journey: From Start to Success</p> <p>(28:34): Navigating Startup Operations: From Team Building to Executive Hiring</p> <p>(28:58): "Lessons on Assembling Your Founding Team: Complimentary Co-founders, Cult Creation, and Problem Solving"</p> <p>(01:41:31): "Exploring Venture: Lessons on Assembling Founders, Succeeding in Early Stage Investing, and Venture Capital"</p> <p>(01:41:53): "Assessing Extraordinary Founders: Traits, Strategies, and Unconventional Qualities"</p> <p>(02:34:31): "Productivity and Life Advice: Strategies for Success in Venture and Beyond"</p> <p>(02:34:50): Contrarian Thinking and Managing Time: Lessons for Success</p> <p>(03:06:20): Outro</p>
11 total episodes available
Deep-dive analytics for Scaling Knowledge
Frequently asked questions
Have a different question and can't find the answer you're looking for? Reach out to our support team by sending us an email and we'll get back to you as soon as we can.
- What is Scaling Knowledge?
- How often does this podcast release new episodes?
This podcast updates daily.
- Where can I listen to this podcast?
This podcast is available on 4 platforms including Apple Podcasts, Spotify, and more. You can also use the RSS feed directly.
- Does this podcast accept guests?
Yes, this podcast regularly features guests.
Legal Disclaimer
Pod Engine is not affiliated with, endorsed by, or officially connected with any of the podcasts displayed on this platform. We operate independently as a podcast discovery and analytics service.
All podcast artwork, thumbnails, and content displayed on this page are the property of their respective owners and are protected by applicable copyright laws. This includes, but is not limited to, podcast cover art, episode artwork, show descriptions, episode titles, transcripts, audio snippets, and any other content originating from the podcast creators or their licensors.
We display this content under fair use principles and/or implied license for the purpose of podcast discovery, information, and commentary. We make no claim of ownership over any podcast content, artwork, or related materials shown on this platform. All trademarks, service marks, and trade names are the property of their respective owners.
While we strive to ensure all content usage is properly authorized, if you are a rights holder and believe your content is being used inappropriately or without proper authorization, please contact us immediately at hey@podengine.ai for prompt review and appropriate action, which may include content removal or proper attribution.
By accessing and using this platform, you acknowledge and agree to respect all applicable copyright laws and intellectual property rights of content owners. Any unauthorized reproduction, distribution, or commercial use of the content displayed on this platform is strictly prohibited.
