02-23-2023, 11:08 PM
IQ Just Got 10,000x Cheaper: Declining Cost Curves in AI Training
<div>
<div class="kk-star-ratings kksr-auto kksr-align-left kksr-valign-top" data-payload='{"align":"left","id":"1156342","slug":"default","valign":"top","ignore":"","reference":"auto","class":"","count":"1","legendonly":"","readonly":"","score":"5","starsonly":"","best":"5","gap":"5","greet":"Rate this post","legend":"5\/5 - (1 vote)","size":"24","width":"142.5","_legend":"{score}\/{best} - ({count} {votes})","font_factor":"1.25"}'>
<div class="kksr-stars">
<div class="kksr-stars-inactive">
<div class="kksr-star" data-star="1" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="2" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="3" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="4" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="5" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
</p></div>
<div class="kksr-stars-active" style="width: 142.5px;">
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
</p></div>
</div>
<div class="kksr-legend" style="font-size: 19.2px;"> 5/5 – (1 vote) </div>
</p></div>
<p class="has-base-background-color has-background"><em><strong>“I am not interested in hearing ridiculous Utopian rants.”</strong></em></p>
<p>said one reader of yesterday’s <a href="https://blog.finxter.com/email-academy/" data-type="page" data-id="12278" target="_blank" rel="noreferrer noopener">Finxter newsletter</a> on my note on <em><strong>declining cost curves</strong></em> and the implied disruptions.</p>
<p>I’ll include a screenshot of the email here:</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="654" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-323-1024x654.png" alt="" class="wp-image-1156357" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-323-1024x654.png 1024w, https://blog.finxter.com/wp-content/uplo...00x192.png 300w, https://blog.finxter.com/wp-content/uplo...68x491.png 768w, https://blog.finxter.com/wp-content/uplo...36x982.png 1536w, https://blog.finxter.com/wp-content/uplo...ge-323.png 1712w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p class="has-base-background-color has-background"><img src="https://s.w.org/images/core/emoji/14.0.0/72x72/1f4a1.png" alt="?" class="wp-smiley" style="height: 1em; max-height: 1em;" /> <strong>Info</strong>: <em>Declining cost curves refer to the trend of production costs decreasing over time as technology and production processes improve. This trend leads to more affordable and accessible products and services, creating new opportunities and disrupting traditional industries and jobs. Think of it like a “cost savings snowball” that gets bigger and bigger as technology advances.</em></p>
<p>I got a lot of positive comments, too, but let’s focus for a moment on this one because it demonstrates how not to behave in the upcoming years of radical change and transformation.</p>
<p>Let’s recap my note on the declining cost curves for AI training:</p>
<p class="has-global-color-8-background-color has-background"><em>ChatGPT and a <strong>~60% annual reduction of AI training costs</strong>. The cost of average intelligence is now 10,000x lower, disrupting white-collar labor markets, logistics, universities, law, coding, artists, secretaries, and many other industries.</em></p>
<p>In this article, allow me to give you more data on this. Feel free to skip ahead if you’re convinced the previous statement is not “ridiculous”.</p>
<p>The following chart from <a href="https://research.ark-invest.com/hubfs/1_Download_Files_ARK-Invest/Big_Ideas/ARK%20Invest_013123_Presentation_Big%20Ideas%202023_Final.pdf" data-type="URL" data-id="https://research.ark-invest.com/hubfs/1_Download_Files_ARK-Invest/Big_Ideas/ARK%20Invest_013123_Presentation_Big%20Ideas%202023_Final.pdf" target="_blank" rel="noreferrer noopener">ARK’s research</a> shows the 10x decline in AI costs in only two years.</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="387" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-2-1024x387.jpeg" alt="" class="wp-image-1156363" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-2-1024x387.jpeg 1024w, https://blog.finxter.com/wp-content/uplo...0x113.jpeg 300w, https://blog.finxter.com/wp-content/uplo...8x290.jpeg 768w, https://blog.finxter.com/wp-content/uplo...age-2.jpeg 1370w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p>Declining by 70% twice is represents a total decline of 91%, i.e., slightly more than 10x!</p>
<p>This steep decline in AI training costs combines software and hardware training costs. Both sit on independently <em><strong>declining cost curves</strong></em> in their own right:</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="381" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-1-1024x381.jpeg" alt="" class="wp-image-1156362" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-1-1024x381.jpeg 1024w, https://blog.finxter.com/wp-content/uplo...0x112.jpeg 300w, https://blog.finxter.com/wp-content/uplo...8x285.jpeg 768w, https://blog.finxter.com/wp-content/uplo...age-1.jpeg 1356w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p><strong>Grasping exponentials is tough for our biological brains.</strong></p>
<p>With abundant intelligence, we’ll integrate super-human AI into more and more apps and devices. Everything will become more intelligent all around us.</p>
<p>Your coding IDE, Excel spreadsheet, heating system, car, glasses, clothes. Very soon, all of them will possess super-human intelligence due to the declining AI training costs.</p>
<p>As a <a href="https://blog.finxter.com/computer-science-research-scientist/" data-type="post" data-id="346253" target="_blank" rel="noreferrer noopener">researcher</a>, I learned that I needed to look at the evidence rather than letting my biases cloud my view—facts, not opinions.</p>
<p>I am puzzled that billions of people today still don’t believe the evident, apparent, mind-boggling disruptions. Your job is as unsafe as mine. I could sugarcoat it, but what’s the use?</p>
<p>Look at the productivity improvement of AI-assisted coding:</p>
<div class="wp-block-image">
<figure class="aligncenter size-full"><img decoding="async" loading="lazy" width="614" height="440" src="https://blog.finxter.com/wp-content/uploads/2023/02/image.jpeg" alt="" class="wp-image-1156361" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image.jpeg 614w, https://blog.finxter.com/wp-content/uplo...0x215.jpeg 300w" sizes="(max-width: 614px) 100vw, 614px" /></figure>
</div>
<p>Wow, just like that, an organization like Google, Tesla, Facebook, OpenAI can double their coding productivity. But what about graphical design?</p>
<div class="wp-block-image">
<figure class="aligncenter size-full"><img decoding="async" loading="lazy" width="629" height="341" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-3.jpeg" alt="" class="wp-image-1156364" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-3.jpeg 629w, https://blog.finxter.com/wp-content/uplo...0x163.jpeg 300w" sizes="(max-width: 629px) 100vw, 629px" /></figure>
</div>
<p>If I write that the costs of intelligence decreased by 10,000x, I mean that literally:</p>
<p class="has-global-color-8-background-color has-background"><em><strong>Genuine valuable content that would cost $100 in 2020 can now be purchased for less than $0.01 with ChatGPT.</strong></em></p>
<p>And ChatGPT today – at IQ 147 <a href="https://medium.com/@jdseo/chatgpt-vs-iq-test-how-did-it-do-7a107b7afadd" data-type="URL" data-id="https://medium.com/@jdseo/chatgpt-vs-iq-test-how-did-it-do-7a107b7afadd" target="_blank" rel="noreferrer noopener">reportedly</a> – is the dumbest it will ever be. From here on out, it will become more and more intelligent and be at our service at a lower and lower price.</p>
<p>Yes, it will reach super-human level performance in coding. Yes, it will create beautiful content, music, art, stories, sales pages, research practically for free.</p>
<p><strong>What is left for us humans to do?</strong></p>
<p>Well, your guess is as good as mine. At least, let’s try to remain open-minded and use the technology daily so you won’t get left behind.</p>
<p>For example, you could use ChatGPT to create advanced apps that were previously impossible for a one-person coding startup. Now, you can disrupt the big guys with a small ChatGPT API call.</p>
<p>~~~</p>
<p>If you’re interested in learning how to integrate ChatGPT in your own Python web apps, feel free to check out our new academy course:</p>
<figure class="wp-block-image size-large"><a href="https://academy.finxter.com/university/chatgpt-at-the-heart-building-a-movie-recommendation-python-web-app-in-2023/" target="_blank" rel="noreferrer noopener"><img decoding="async" loading="lazy" width="1024" height="675" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-324-1024x675.png" alt="" class="wp-image-1156365" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-324-1024x675.png 1024w, https://blog.finxter.com/wp-content/uplo...00x198.png 300w, https://blog.finxter.com/wp-content/uplo...68x506.png 768w, https://blog.finxter.com/wp-content/uplo...ge-324.png 1256w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>
<p><a href="https://academy.finxter.com/university/chatgpt-at-the-heart-building-a-movie-recommendation-python-web-app-in-2023/" target="_blank" rel="noreferrer noopener">[Course] ChatGPT at the Heart – Building a Movie Recommendation Python Web App in 2023</a></p>
<p>As with all our courses, this course comes with a personalized PDF certificate with your name to showcase your skills to clients or your future employer.</p>
<p>~~~</p>
<p>I’ll close today’s article with this concluding thought: humans tend to adapt very quickly if forced to. Just two months ago, most people would have pushed back on the thought that AI is able to create super-human-level art, code, or content.</p>
<p>Now, only a few people do.</p>
<p>In only two years, AI training costs will have been reduced by another 10x, and we’ll see generative videos and whole books being written in seconds.</p>
<p>We will see peer-reviewed ChatGPT research papers that managed to pass double-blind journal review systems.</p>
<p>Throughout human history, intelligence has been a limiting factor for our economy. It no longer is. You can choose to ignore this or you can choose to embrace change. The world, however, will move on either way.</p>
<p>I’m sending you much love, my friend! <img decoding="async" alt="♥" src="https://fonts.gstatic.com/s/e/notoemoji/15.0/2665_fe0f/32.png"></p>
</div>
https://www.sickgaming.net/blog/2023/02/...-training/
<div>
<div class="kk-star-ratings kksr-auto kksr-align-left kksr-valign-top" data-payload='{"align":"left","id":"1156342","slug":"default","valign":"top","ignore":"","reference":"auto","class":"","count":"1","legendonly":"","readonly":"","score":"5","starsonly":"","best":"5","gap":"5","greet":"Rate this post","legend":"5\/5 - (1 vote)","size":"24","width":"142.5","_legend":"{score}\/{best} - ({count} {votes})","font_factor":"1.25"}'>
<div class="kksr-stars">
<div class="kksr-stars-inactive">
<div class="kksr-star" data-star="1" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="2" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="3" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="4" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" data-star="5" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
</p></div>
<div class="kksr-stars-active" style="width: 142.5px;">
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
<div class="kksr-star" style="padding-right: 5px">
<div class="kksr-icon" style="width: 24px; height: 24px;"></div>
</p></div>
</p></div>
</div>
<div class="kksr-legend" style="font-size: 19.2px;"> 5/5 – (1 vote) </div>
</p></div>
<p class="has-base-background-color has-background"><em><strong>“I am not interested in hearing ridiculous Utopian rants.”</strong></em></p>
<p>said one reader of yesterday’s <a href="https://blog.finxter.com/email-academy/" data-type="page" data-id="12278" target="_blank" rel="noreferrer noopener">Finxter newsletter</a> on my note on <em><strong>declining cost curves</strong></em> and the implied disruptions.</p>
<p>I’ll include a screenshot of the email here:</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="654" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-323-1024x654.png" alt="" class="wp-image-1156357" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-323-1024x654.png 1024w, https://blog.finxter.com/wp-content/uplo...00x192.png 300w, https://blog.finxter.com/wp-content/uplo...68x491.png 768w, https://blog.finxter.com/wp-content/uplo...36x982.png 1536w, https://blog.finxter.com/wp-content/uplo...ge-323.png 1712w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p class="has-base-background-color has-background"><img src="https://s.w.org/images/core/emoji/14.0.0/72x72/1f4a1.png" alt="?" class="wp-smiley" style="height: 1em; max-height: 1em;" /> <strong>Info</strong>: <em>Declining cost curves refer to the trend of production costs decreasing over time as technology and production processes improve. This trend leads to more affordable and accessible products and services, creating new opportunities and disrupting traditional industries and jobs. Think of it like a “cost savings snowball” that gets bigger and bigger as technology advances.</em></p>
<p>I got a lot of positive comments, too, but let’s focus for a moment on this one because it demonstrates how not to behave in the upcoming years of radical change and transformation.</p>
<p>Let’s recap my note on the declining cost curves for AI training:</p>
<p class="has-global-color-8-background-color has-background"><em>ChatGPT and a <strong>~60% annual reduction of AI training costs</strong>. The cost of average intelligence is now 10,000x lower, disrupting white-collar labor markets, logistics, universities, law, coding, artists, secretaries, and many other industries.</em></p>
<p>In this article, allow me to give you more data on this. Feel free to skip ahead if you’re convinced the previous statement is not “ridiculous”.</p>
<p>The following chart from <a href="https://research.ark-invest.com/hubfs/1_Download_Files_ARK-Invest/Big_Ideas/ARK%20Invest_013123_Presentation_Big%20Ideas%202023_Final.pdf" data-type="URL" data-id="https://research.ark-invest.com/hubfs/1_Download_Files_ARK-Invest/Big_Ideas/ARK%20Invest_013123_Presentation_Big%20Ideas%202023_Final.pdf" target="_blank" rel="noreferrer noopener">ARK’s research</a> shows the 10x decline in AI costs in only two years.</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="387" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-2-1024x387.jpeg" alt="" class="wp-image-1156363" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-2-1024x387.jpeg 1024w, https://blog.finxter.com/wp-content/uplo...0x113.jpeg 300w, https://blog.finxter.com/wp-content/uplo...8x290.jpeg 768w, https://blog.finxter.com/wp-content/uplo...age-2.jpeg 1370w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p>Declining by 70% twice is represents a total decline of 91%, i.e., slightly more than 10x!</p>
<p>This steep decline in AI training costs combines software and hardware training costs. Both sit on independently <em><strong>declining cost curves</strong></em> in their own right:</p>
<div class="wp-block-image">
<figure class="aligncenter size-large"><img decoding="async" loading="lazy" width="1024" height="381" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-1-1024x381.jpeg" alt="" class="wp-image-1156362" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-1-1024x381.jpeg 1024w, https://blog.finxter.com/wp-content/uplo...0x112.jpeg 300w, https://blog.finxter.com/wp-content/uplo...8x285.jpeg 768w, https://blog.finxter.com/wp-content/uplo...age-1.jpeg 1356w" sizes="(max-width: 1024px) 100vw, 1024px" /></figure>
</div>
<p><strong>Grasping exponentials is tough for our biological brains.</strong></p>
<p>With abundant intelligence, we’ll integrate super-human AI into more and more apps and devices. Everything will become more intelligent all around us.</p>
<p>Your coding IDE, Excel spreadsheet, heating system, car, glasses, clothes. Very soon, all of them will possess super-human intelligence due to the declining AI training costs.</p>
<p>As a <a href="https://blog.finxter.com/computer-science-research-scientist/" data-type="post" data-id="346253" target="_blank" rel="noreferrer noopener">researcher</a>, I learned that I needed to look at the evidence rather than letting my biases cloud my view—facts, not opinions.</p>
<p>I am puzzled that billions of people today still don’t believe the evident, apparent, mind-boggling disruptions. Your job is as unsafe as mine. I could sugarcoat it, but what’s the use?</p>
<p>Look at the productivity improvement of AI-assisted coding:</p>
<div class="wp-block-image">
<figure class="aligncenter size-full"><img decoding="async" loading="lazy" width="614" height="440" src="https://blog.finxter.com/wp-content/uploads/2023/02/image.jpeg" alt="" class="wp-image-1156361" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image.jpeg 614w, https://blog.finxter.com/wp-content/uplo...0x215.jpeg 300w" sizes="(max-width: 614px) 100vw, 614px" /></figure>
</div>
<p>Wow, just like that, an organization like Google, Tesla, Facebook, OpenAI can double their coding productivity. But what about graphical design?</p>
<div class="wp-block-image">
<figure class="aligncenter size-full"><img decoding="async" loading="lazy" width="629" height="341" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-3.jpeg" alt="" class="wp-image-1156364" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-3.jpeg 629w, https://blog.finxter.com/wp-content/uplo...0x163.jpeg 300w" sizes="(max-width: 629px) 100vw, 629px" /></figure>
</div>
<p>If I write that the costs of intelligence decreased by 10,000x, I mean that literally:</p>
<p class="has-global-color-8-background-color has-background"><em><strong>Genuine valuable content that would cost $100 in 2020 can now be purchased for less than $0.01 with ChatGPT.</strong></em></p>
<p>And ChatGPT today – at IQ 147 <a href="https://medium.com/@jdseo/chatgpt-vs-iq-test-how-did-it-do-7a107b7afadd" data-type="URL" data-id="https://medium.com/@jdseo/chatgpt-vs-iq-test-how-did-it-do-7a107b7afadd" target="_blank" rel="noreferrer noopener">reportedly</a> – is the dumbest it will ever be. From here on out, it will become more and more intelligent and be at our service at a lower and lower price.</p>
<p>Yes, it will reach super-human level performance in coding. Yes, it will create beautiful content, music, art, stories, sales pages, research practically for free.</p>
<p><strong>What is left for us humans to do?</strong></p>
<p>Well, your guess is as good as mine. At least, let’s try to remain open-minded and use the technology daily so you won’t get left behind.</p>
<p>For example, you could use ChatGPT to create advanced apps that were previously impossible for a one-person coding startup. Now, you can disrupt the big guys with a small ChatGPT API call.</p>
<p>~~~</p>
<p>If you’re interested in learning how to integrate ChatGPT in your own Python web apps, feel free to check out our new academy course:</p>
<figure class="wp-block-image size-large"><a href="https://academy.finxter.com/university/chatgpt-at-the-heart-building-a-movie-recommendation-python-web-app-in-2023/" target="_blank" rel="noreferrer noopener"><img decoding="async" loading="lazy" width="1024" height="675" src="https://blog.finxter.com/wp-content/uploads/2023/02/image-324-1024x675.png" alt="" class="wp-image-1156365" srcset="https://blog.finxter.com/wp-content/uploads/2023/02/image-324-1024x675.png 1024w, https://blog.finxter.com/wp-content/uplo...00x198.png 300w, https://blog.finxter.com/wp-content/uplo...68x506.png 768w, https://blog.finxter.com/wp-content/uplo...ge-324.png 1256w" sizes="(max-width: 1024px) 100vw, 1024px" /></a></figure>
<p><a href="https://academy.finxter.com/university/chatgpt-at-the-heart-building-a-movie-recommendation-python-web-app-in-2023/" target="_blank" rel="noreferrer noopener">[Course] ChatGPT at the Heart – Building a Movie Recommendation Python Web App in 2023</a></p>
<p>As with all our courses, this course comes with a personalized PDF certificate with your name to showcase your skills to clients or your future employer.</p>
<p>~~~</p>
<p>I’ll close today’s article with this concluding thought: humans tend to adapt very quickly if forced to. Just two months ago, most people would have pushed back on the thought that AI is able to create super-human-level art, code, or content.</p>
<p>Now, only a few people do.</p>
<p>In only two years, AI training costs will have been reduced by another 10x, and we’ll see generative videos and whole books being written in seconds.</p>
<p>We will see peer-reviewed ChatGPT research papers that managed to pass double-blind journal review systems.</p>
<p>Throughout human history, intelligence has been a limiting factor for our economy. It no longer is. You can choose to ignore this or you can choose to embrace change. The world, however, will move on either way.</p>
<p>I’m sending you much love, my friend! <img decoding="async" alt="♥" src="https://fonts.gstatic.com/s/e/notoemoji/15.0/2665_fe0f/32.png"></p>
</div>
https://www.sickgaming.net/blog/2023/02/...-training/