Skip to content(if available)orjump to list(if available)

Show HN: Chat with multiple LLMs: o1-high-effort, Sonnet 3.5, GPT-4o, and more

Show HN: Chat with multiple LLMs: o1-high-effort, Sonnet 3.5, GPT-4o, and more

36 comments

·January 21, 2025

Hello HN! I was fed up switching between multiple UIs to ask GPT, Claude, etc… the same question and comparing the answers. So I built a way to ask multiple models the same question efficiently by having the LLM compare the responses and only show you new and valuable information from the 2nd model. This way you still get a fast response as normal from the 1st model, but also get any added value provided by the 2nd model.

Initially I built my own UI to use this, but stumbled upon Open WebUI (formerly Ollama WebUI) which is fantastic, but is made more for local access to LLMs. So I talked to its creator, Timothy Baek, and he mentioned that security needed to be shored up before production deployment. I did some scans with semgrep, and fixed some XSRF and CORS issues along with making sure the JWT tokens, passwords, etc… were secure. This was in addition to other folks' amazing security contributions. So now we build on Open WebUI! oss ftw

After launching privately a month or so ago and posting a few reddit links, I have about 100 users.

We also just got access to the o1 API and provide o1-high, medium, and low effort. o1 high effort is able to solve coding problems that only o1 pro can also solve, though pro can go further and has better formatting, o1 high effort is a nice option if you don't want to fork over $200/mo.

https://www.reddit.com/r/OpenAI/comments/1i0r867/comment/m70...

You can use o1 for free in PolyChat, which is the only place I've seen you can do so.

You can also ask multiple models the same question and stream the answers simultaneously side by side. https://imgur.com/a/ly5ZPh8

And you can have multiple chats going simultaneously and they will continue in the background and notify you when they're done.

Another cool feature that makes long chats way easier to navigate is the overview (three dots on top right of chat) https://imgur.com/a/PoB1phT

We give you full control, unlike most providers, to change the system prompt, temperature, etc.. in the chat settings in the "Controls" on the top right.

The formatting for code outputs and inputs is fantastic, using codemirror, and you can run code in the code blocks if it's python or JS using in-browser runtimes.

You can also share chats within polychat where other logged in users can see them:

e.g. https://polychat.co/s/ec163812-9323-4cb5-a429-7ddeaf3572c3

Or you can share it publicly to the OpenWeb UI community

https://openwebui.com/c/crizcraig/e1b2fff9-30a3-4ee7-8eed-b2...

Finally we allow you to search and organize your chats into folders which makes finding things super fast!

Infra: My custom backend that combines models and does things Open WebUI doesn't handle like token tracking is written in FastAPI and uses LiteLLM for easily accessing different model APIs. I host everything on GCP using Cloud Run for the backend and use PostGres for Open WebUI's db, along with BigQuery and Firestore for my FastAPI app's db.

Pricing: Our pricing makes it cheap to access top models. It's free at first, then we offer subscription tiers starting at $5/mo which allots about ~1 million tokens per month, enough for most people. But unlike Claude's UI for example, we don't shut you down with rate limits, but rather let heavy users upgrade beyond to $10, $20, $40, $80, etc... We also suggest a plan based on how quickly you used your free tokens, so you have an idea upfront of the monthly cost before you buy. And you can upgrade or downgrade at any time.

Thanks Show HN <3

hoerzu

Created an open source alternative just using the browser and not sharing your data with a third party: https://chromewebstore.google.com/detail/tabgpt-ask-chatgpt-...

cr4zy

Cool! I should say most of PolyChat is open source at https://github.com/open-webui - just the combo models and payment are closed source right now. Open to arguments on making PolyChat fully open source as well!

noahjk

Sounds like you made most of these changes upstream? What about the background chats and the chat tree overview, are either of them in Open WebUI, or are they also custom to PolyChat? I run OWUI locally and am interested in those features for selfish reasons. If for some reason your multi-model idea doesn’t pan out, I’d love to see it merged upstream, too. Thanks for your contributions!

(Another annoying thing about OWUI is getting logged out every time the image upgrades… is that something else you’ve looked at?)

cr4zy

Background chats are new in v5 of Open WebUI, so you can use it too. Overview has been there also, but it's kind hidden in the hamburger menu.

The upgrade/logout issue you're facing is likely due to not setting WEBUI_SECRET_KEY outside of your docker container. This causes all previous cookies to be unreadable as a new key will get generated by start.sh and won't decrypt the old cookies.

pogue

Fyi: Duckduckgo has a free ai chat with o1-mini at https://duck.ai

They also offer Claude 3 Haiku, Llama 3.1 70B and Mixtral 8x7B. No account required and they say it's not logged + anonymous. I'm sure they have limits but I never reached them.

rany_

They offer 4o-mini, not o1-mini.

oidar

This is very good at this right now too: https://melty.sh/chorus

iandanforth

You should also note that Chorus allows you to bring your own API keys and interact with local models. Both features I very much appreciate!

cr4zy

One tradeoff of bringing your own API keys is that as you add more model providers, you get more billing accounts to deal with. Chorus also doesn't have an incentive to efficiently use your tokens. We save 67% on Anthropic token costs using Claude Caching. We also use cheaper "task models" for conversation titles, tagging, and parts of the RAG pipeline which all drastically cuts token costs.

For local models I highly recommend https://github.com/crizCraig/open-webui

They do the side by side thing that Chorus does and you can serve it to anywhere including your phone.

amelius

This is like showing the top 3 results from Google search side by side. I'm not sure that's what I want, to be honest.

oidar

You haven't dug in far enough. It's not for chatting with LLMs, it's for comparing LLMs.

diggan

No, more like showing the top 3 results from Google, Bing, and Kagi at the same time next to each other, if anything.

artdigital

Some other options:

OpenRouter has similar features with any model that’s available on OpenRouter through open router billing

On the desktop, Msty can do this too

victorantos

I’ve built a multi chat web app as well, atm offering 3 simultaneous chats: ChatGPT, Claude and Gemini

My USP is that you can generate and share a n image of the chats, more for Premium users.

https://sneos.com

nemoniac

gptel can do this already with over 20 models.

Costs nothing beyond your subscriptions to the individual models.

https://github.com/karthink/gptel

The author shows it with 4 models at once in this demo video:

https://www.youtube.com/watch?v=bsRnh_brggM&t=853s

victorantos

Looks great! I’m working on something similar: https://sneos.com. Planning to launch on HN once I nail down the scaling and usage limits—currently free for everyone. Would love to hear how your journey with Polychat is going!

olddog2

Cool, but nano-gpt.com do pay per use for about 100 chat and image models including o1pro, deepseek r1 etc.

null

[deleted]

wslh

We have Geppetto, a FOSS that you can ask questions within Slack and using several services. Feel free to fork it: <https://github.com/Deeptechia/geppetto>

cr4zy

So it looks like some folks are getting errors with the non-streaming models, i.e. the o1 models. I think their long running cxns with zero packets may cause some networks to drop the requests. Will look into a hearbeat/keepalive on those.

cr4zy

I've added a "Thinking...." which sends server side events to keep the cxn open. Would love to hear if o1 models now work for anyone who they were broken for.

liberix

I've noticed that you offer an API key under Settings / Account. How does the API work? Is there any documentation? I'd also like to see the pricing details for the different plans.

cr4zy

Open WebUI does offer an API, but I have it disabled for PolyChat.

ilrwbwrkhv

If it doesn't have DeepSeek R1 it is a non starter.