Over the past few weeks I have been building a new service for our internal use within company to utilize different A.I. models for various tasks. It's amazing to see how far the A.I. tools have evolved in such a short time. Not just the models themselves, but the tools and frameworks utilizing them and building services on top of them.
We have been using various tools for different tasks, but there are several problems with that approach. First is the cost. Those services are usually priced per user so it's a lot of money to get even one for use for all employees.
The second problem just multiplies the first one. The tools, beyond the really generic base "chat" services are limited to certain tasks. So just one isn't enough, you need to get all kind of different services to cover all aspects of our work.
Data privacy and confidentiality is also a big challenge. We work with a lot of confidential data that we can't just send to services where we can't be certain the data won't leak or be used to train the underlying model further.