Update: significantly faster LLM response times

I’ll spare you the gruesome details, but I’m proud to report that https://neThing.xyz is now significantly faster. We found a few creative ways to shave ~5-20 seconds off of the query engine response time.

While we’ve received a lot of compliments on the spinning “Loading…” 3D model, that’s not what we want you to be seeing (for very long)!

Early data from today suggests that the speed is roughly double (latency cut in half)

1 Like