What is Salesforce Research's CodeTF?

Open-Source is thriving in A.I.

Photo: Salesforce AI Research.

Hi Everyone,

The 10th paper of Elvis’s list last week has really caught my attention.

🥇Top ML Papers of the Week

I’m a huge fan of the work Salesforce Research is doing. This paper is trending on Papers with Code.

• GitHub link. https://github.com/salesforce/CodeTF

They authors say: In this paper, we present CodeTF, an open-source Transformer-based library for state-of-the-art Code LLMs and code intelligence. Following the principles of modular design and extensible framework, we design CodeTF with a unified interface to enable rapid access and development across different types of models, datasets and tasks. Our library supports a collection of pretrained Code LLM models and popular code benchmarks, including a standardized interface to train and serve code LLMs efficiently, and data features such as language-specific parsers and utility functions for extracting code attributes.

CodeTF

In this paper, they describe the design principles, the architecture, key modules and components, and compare with other related library tools. Finally, we hope CodeTF is able to bridge the gap between machine learning/generative AI and software engineering, providing a comprehensive open-source solution for developers, researchers, and practitioners.

Is Salesforce Pro Open-Source LLM Research?

Just as Meta and Amazon have made strides to help the open-source LLM democratization of A.I, I wonder if Salesforce is here doing the same? CodeTF makes it easier for engineers and developers to access CodeLLM technology faster and easier.

EinsteinGPT is already a generative A.I. product for CRM. Salesforce has $8 billion in revenue and is starting to understand the future of Data and LLMs to its future.

CodeTF is thus a good achievement.

According to Nghi Bui,

1. They also provide a unified interface to parse code into the Abstract Syntax Tree (AST) and manipulate the AST in MULTIPLE programming languages without the need to install additional libraries.

2. CodeTF handles all aspects of device management, so users do not have to worry about that aspect. If your model is large, we offer advanced features such as weight sharding across GPUs to serve the models more quickly.

CodeTF is an Open-Source Comprehensive Library for Transformer-based LLMs

CodeTF, an open-source comprehensive library for Transformer-based LLMs and their application in code intelligence tasks.

Salesforce partnered with both OpenAI for EinsteinGPT and with Anthropic A.I. It turns out Anthropic is one of the first investments they made out of the new $250 million Generative AI fund Salesforce Ventures launched in March 2023. I think that will turn out to be a good investment.