<?xml version="1.0" encoding="UTF-8"?> <rss
version="2.0"
xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:wfw="http://wellformedweb.org/CommentAPI/"
xmlns:dc="http://purl.org/dc/elements/1.1/"
xmlns:atom="http://www.w3.org/2005/Atom"
xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
> <channel><title>Autarchy of the Private Cave &#187; Machine learning</title> <atom:link href="https://bogdan.org.ua/categories/artificial-intelligence/machine-learning/feed" rel="self" type="application/rss+xml" /><link>https://bogdan.org.ua</link> <description>Tiny bits of bioinformatics, [web-]programming etc</description> <lastBuildDate>Wed, 28 Dec 2022 16:09:04 +0000</lastBuildDate> <language>en-US</language> <sy:updatePeriod>hourly</sy:updatePeriod> <sy:updateFrequency>1</sy:updateFrequency> <generator>https://wordpress.org/?v=3.8.27</generator> <item><title>Kite AI coding assistant is saying farewell</title><link>https://bogdan.org.ua/2022/12/28/kite-ai-coding-assistant-is-saying-farewell.html</link> <comments>https://bogdan.org.ua/2022/12/28/kite-ai-coding-assistant-is-saying-farewell.html#comments</comments> <pubDate>Wed, 28 Dec 2022 16:08:46 +0000</pubDate> <dc:creator><![CDATA[Bogdan]]></dc:creator> <category><![CDATA[Machine learning]]></category> <category><![CDATA[Programming]]></category> <category><![CDATA[Software]]></category> <category><![CDATA[Technologies]]></category> <category><![CDATA[copilot]]></category> <category><![CDATA[kite]]></category> <category><![CDATA[mutable]]></category> <category><![CDATA[tabnine]]></category> <guid
isPermaLink="false">https://bogdan.org.ua/?p=2578</guid> <description><![CDATA[I&#8217;m looking at AI/ML-powered coding assistants (such as mutable.ai, github&#8217;s CoPilot, tabnine, and even Alibaba AI assistant &#8211; but there everything was in Chinese so I didn&#8217;t proceed at all with it), and found &#8211; with sadness &#8211; that Kite, one of the longer-existing solutions (since 2014!) has gone out of business&#8230; Here is Kite&#8217;s [&#8230;]]]></description> <content:encoded><![CDATA[<p>I&#8217;m looking at AI/ML-powered coding assistants (such as <a
href="https://mutable.ai/pricing/" title="mutable.ai pricing" class="broken_link" rel="nofollow">mutable.ai</a>, <a
href="https://github.com/pricing" title="GitHub CoPilot pricing">github&#8217;s CoPilot</a>, <a
href="https://www.tabnine.com/pricing" title="tabnine pricing">tabnine</a>, and even Alibaba AI assistant &#8211; but there everything was in Chinese so I didn&#8217;t proceed at all with it), and found &#8211; with sadness &#8211; that Kite, one of the longer-existing solutions (since 2014!) has gone out of business&#8230;</p><p>Here is <a
href="https://www.kite.com/blog/product/kite-is-saying-farewell/" title="Kite farewell">Kite&#8217;s farewell</a> for you to read.</p><p>Kite did open-source many parts of <a
href="https://github.com/kiteco" title="Kite GitHub">their technology/software stack</a>, though I didn&#8217;t check how comprehensive those parts are, and if that is anywhere near enough to fork/continue their work.<br
/> I wonder if there already exists an open-source project focusing on ML-based code completion for e.g. Python &#8211; let me know in the comments if you know one!</p><p><span
id="more-2578"></span></p><p>Kite cites two reasons for a shutdown: <strong>1) technology not being quite there yet</strong>, and <strong>2) failure to monetize</strong>.<br
/> Kite had up to 500k daily developers using the platform, but apparently extremely few were willing to pay for it.<br
/> If you do look at current ML code assistants, there seems to always exist at least some free tier &#8211; I wonder if that is <em>forced</em> by the same lackluster, non-paying developers attitude as for Kite.</p><p>Kite&#8217;s farewell had another interesting number: <strong>18%</strong>.<br
/> That is by how much individual developer&#8217;s productivity could increase thanks to Kite&#8217;s assistance.<br
/> This isn&#8217;t bad at all; for a team of 5 largely independent developers, it&#8217;s almost one extra &#8220;affordable&#8221; developer.<br
/> Kite was striving to achieve a &#8220;10x improvement&#8221;, but at least to me the <strong>18% improvement</strong> sounds good enough for sales.</p><p>I&#8217;m very curious to try some of these assistants out.<br
/> I can imagine them to be very helpful for relatively experienced developers when starting to work with a new library/ecosystem &#8211; for example, OpenVision Python bindings.<br
/> Even the common autocomplete can significantly simplify &#8220;onboarding&#8221; to a new library &#8211; and a more intelligent autocomplete should be able to help with boilerplate code (that you usually don&#8217;t have when you begin), as well as with some <em>idiomatic</em> expressions and statements.</p><p>Have you already played with some of the <em>smarter</em> code assistants?<br
/> What was your experience?<br
/> Please share <img
src="https://bogdan.org.ua/wp-includes/images/smilies/icon_smile.gif" alt=":)" class="wp-smiley" /></p><p><a
class="a2a_button_citeulike" href="https://www.addtoany.com/add_to/citeulike?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&amp;linkname=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" title="CiteULike" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_pocket" href="https://www.addtoany.com/add_to/pocket?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&amp;linkname=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" title="Pocket" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_kindle_it" href="https://www.addtoany.com/add_to/kindle_it?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&amp;linkname=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" title="Kindle It" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_evernote" href="https://www.addtoany.com/add_to/evernote?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&amp;linkname=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" title="Evernote" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_pinterest" href="https://www.addtoany.com/add_to/pinterest?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&amp;linkname=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" title="Pinterest" rel="nofollow noopener" target="_blank"></a><a
class="a2a_dd addtoany_share_save addtoany_share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fbogdan.org.ua%2F2022%2F12%2F28%2Fkite-ai-coding-assistant-is-saying-farewell.html&#038;title=Kite%20AI%20coding%20assistant%20is%20saying%20farewell" data-a2a-url="https://bogdan.org.ua/2022/12/28/kite-ai-coding-assistant-is-saying-farewell.html" data-a2a-title="Kite AI coding assistant is saying farewell"><img
src="https://static.addtoany.com/buttons/share_save_120_16.png" alt="Share"></a></p>]]></content:encoded> <wfw:commentRss>https://bogdan.org.ua/2022/12/28/kite-ai-coding-assistant-is-saying-farewell.html/feed</wfw:commentRss> <slash:comments>0</slash:comments> </item> <item><title>Information criteria for choosing best predictive models</title><link>https://bogdan.org.ua/2012/05/29/information-criteria-for-choosing-best-predictive-models.html</link> <comments>https://bogdan.org.ua/2012/05/29/information-criteria-for-choosing-best-predictive-models.html#comments</comments> <pubDate>Tue, 29 May 2012 11:44:50 +0000</pubDate> <dc:creator><![CDATA[Bogdan]]></dc:creator> <category><![CDATA[Bioinformatics]]></category> <category><![CDATA[Machine learning]]></category> <category><![CDATA[AIC]]></category> <category><![CDATA[BIC]]></category> <category><![CDATA[cross-validation]]></category> <category><![CDATA[information criterion]]></category> <category><![CDATA[R]]></category> <category><![CDATA[statistics]]></category> <guid
isPermaLink="false">http://bogdan.org.ua/?p=1831</guid> <description><![CDATA[Usually I&#8217;m using 10-fold (non-stratified) CV to measure the predictive power of the models: it gives consistent results, and is easy to perform (at least on smaller datasets). Just came across the Akaikeâ€™s InforÂ­maÂ­tion Criterion (AIC) and Schwarz Bayesian InforÂ­maÂ­tion Criterion (BIC). Citing robjhyndman, AsympÂ­totÂ­iÂ­cally, minÂ­iÂ­mizÂ­ing the AIC is equivÂ­aÂ­lent to minÂ­iÂ­mizÂ­ing the CV value. [&#8230;]]]></description> <content:encoded><![CDATA[<p>Usually I&#8217;m using 10-fold (non-stratified) <abbr
title="cross-validation">CV</abbr> to measure the predictive power of the models: it gives consistent results, and is easy to perform (at least on smaller datasets).</p><p>Just came across the Akaikeâ€™s InforÂ­maÂ­tion Criterion (AIC) and Schwarz Bayesian InforÂ­maÂ­tion Criterion (BIC). Citing <a
href="http://robjhyndman.com/researchtips/crossvalidation/">robjhyndman</a>,</p><blockquote><p> AsympÂ­totÂ­iÂ­cally, minÂ­iÂ­mizÂ­ing the AIC is equivÂ­aÂ­lent to minÂ­iÂ­mizÂ­ing the CV value. This is true for any model (<a
href="http://www.jstor.org/stable/2984877" class="vt-p broken_link" rel="nofollow">Stone 1977</a>), not just linÂ­ear modÂ­els. It is this propÂ­erty that makes the AIC so useÂ­ful in model selecÂ­tion when the purÂ­pose is prediction.<br
/> &#8230;<br
/> Because of the heavÂ­ier penalty, the model choÂ­sen by BIC is either the same as that choÂ­sen by AIC, or one with fewer terms. AsympÂ­totÂ­iÂ­cally, for linÂ­ear modÂ­els minÂ­iÂ­mizÂ­ing BIC is equivÂ­aÂ­lent to leaveâ€“vâ€“out cross-â€‹â€‹validation when v = n[1-1/(log(n)-1)] (<a
href="http://www3.stat.sinica.edu.tw/statistica/oldpdf/A7n21.pdf" class="vt-p">Shao 1997</a>).</p></blockquote><p>Want to try AIC and maybe BIC on my models. Conveniently, both functions exist in R.</p><p><a
class="a2a_button_citeulike" href="https://www.addtoany.com/add_to/citeulike?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&amp;linkname=Information%20criteria%20for%20choosing%20best%20predictive%20models" title="CiteULike" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_pocket" href="https://www.addtoany.com/add_to/pocket?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&amp;linkname=Information%20criteria%20for%20choosing%20best%20predictive%20models" title="Pocket" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_kindle_it" href="https://www.addtoany.com/add_to/kindle_it?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&amp;linkname=Information%20criteria%20for%20choosing%20best%20predictive%20models" title="Kindle It" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_evernote" href="https://www.addtoany.com/add_to/evernote?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&amp;linkname=Information%20criteria%20for%20choosing%20best%20predictive%20models" title="Evernote" rel="nofollow noopener" target="_blank"></a><a
class="a2a_button_pinterest" href="https://www.addtoany.com/add_to/pinterest?linkurl=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&amp;linkname=Information%20criteria%20for%20choosing%20best%20predictive%20models" title="Pinterest" rel="nofollow noopener" target="_blank"></a><a
class="a2a_dd addtoany_share_save addtoany_share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fbogdan.org.ua%2F2012%2F05%2F29%2Finformation-criteria-for-choosing-best-predictive-models.html&#038;title=Information%20criteria%20for%20choosing%20best%20predictive%20models" data-a2a-url="https://bogdan.org.ua/2012/05/29/information-criteria-for-choosing-best-predictive-models.html" data-a2a-title="Information criteria for choosing best predictive models"><img
src="https://static.addtoany.com/buttons/share_save_120_16.png" alt="Share"></a></p>]]></content:encoded> <wfw:commentRss>https://bogdan.org.ua/2012/05/29/information-criteria-for-choosing-best-predictive-models.html/feed</wfw:commentRss> <slash:comments>0</slash:comments> </item> </channel> </rss>