https://clarence.tw/ja/notes/llm/ Recent content in LLM & AI on Clarence｜Backend・AI・DevOps・Infrastructure Hugo -- gohugo.io ja https://clarence.tw/ja/notes/llm/ollama-setup/ Mon, 01 Jan 0001 00:00:00 +0000 https://clarence.tw/ja/notes/llm/ollama-setup/ <div class="note-card "> <div class="item"> <h5 class="note-title"><span>Install と実行</span></h5> <div class="card"> <div class="card-body"><div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>curl -fsSL https://ollama.com/install.sh | sh </span></span><span style="display:flex;"><span>ollama serve </span></span><span style="display:flex;"><span>ollama pull gemma2:9b </span></span><span style="display:flex;"><span>ollama pull llama3.1:8b </span></span><span style="display:flex;"><span>ollama list </span></span></code></pre></div><p>prompt testing では小さめの model から始め、workflow が安定してから大きな model に移る。</p></div> </div> </div> </div> <div class="note-card "> <div class="item"> <h5 class="note-title"><span>Model commands</span></h5> <div class="card"> <div class="card-body"><div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>ollama run gemma2:9b </span></span><span style="display:flex;"><span>ollama show gemma2:9b </span></span><span style="display:flex;"><span>ollama rm gemma2:9b </span></span></code></pre></div><p>script では model name を明示する。default model の変更で結果が変わるのを避けるため。</p></div> </div> </div> </div> <div class="note-card "> <div class="item"> <h5 class="note-title"><span>Local API</span></h5> <div class="card"> <div class="card-body"><div class="highlight"><pre tabindex="0" style="color:#f8f8f2;background-color:#272822;-moz-tab-size:4;-o-tab-size:4;tab-size:4;-webkit-text-size-adjust:none;"><code class="language-bash" data-lang="bash"><span style="display:flex;"><span>curl http://localhost:11434/api/generate <span style="color:#ae81ff">\ </span></span></span><span style="display:flex;"><span> -d <span style="color:#e6db74">&#39;{&#34;model&#34;:&#34;gemma2:9b&#34;,&#34;prompt&#34;:&#34;Summarize this text.&#34;,&#34;stream&#34;:false}&#39;</span> </span></span></code></pre></div><p>local API は private experiment に便利だが、production では timeout、retry、logging boundary が必要。</p></div> </div> </div> </div>