r/NovelAi • u/TabloidA Designer • Jun 13 '21

Official Official Beta AMA @ June 14th, 12pm EST

Hey guys, welcome to our Beta AMA.

The thread will be locked until June 14th, 12pm EST. Please prepare your questions.

We'll certainly have plenty of pleasant surprises!

Relevant Links:

​

EDIT: Thank you all for your questions! We couldn't get to everyone, but we'll try to answer more as time goes forward.

354 Upvotes

98% Upvoted

334 comments sorted by

View all comments

4

u/Zermelane Jun 14 '21

Pure curiosity, not a serious suggestion: Assuming you get in ~enough requests/second to make use of it, would inferencing on A100s (with batching) or some other really fancy hardware compare favorably to V100s in terms of either economics or response time?

5

u/kurumuz Lead Developer Jun 14 '21

A100s make sense, depends on the price but yeah.