Trends in AI — February 2024

As we fly into the year of the dragon, we keep our finger on the pulse of AI R&D and take a closer look at the progress of the field in China. Here is an overview of some recent developments, along with some of the trending papers from the past month.

News Articles

• Zhipu AI Unveils GLM-4 Model with Advanced Performance Paralleling GPT-4

• OPPO Establishes AI Center to Strengthen Competitive Edge

• ASML halts hi-tech chip-making exports to China reportedly after US request

• Open source vector database startup Qdrant raises $28M

• State of AI Report: Compute Index V3 update!

Model Releases

• Introducing Qwen1.5

• Adept Fuyu-Heavy: A new multimodal model

• Open Language Model: OLMo

• Introducing Nomic Embed: A Truly Open Embedding Model

• Eagle 7B : Soaring past Transformers with 1 Trillion Tokens Across 100+ Languages (RWKV-v5)

Trending AI papers for February 2024

1. InRanker: Distilled Rankers for Zero-shot Information Retrieval by Thiago Laitz et al. (UNICAMP) - 12 Jan. 2024

2. BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation by Jianlv Chen et al. (BAAI) - 5 Feb. 2024

3. INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning by Yutao Zhu et al. (Renmin University) - 12 Jan. 2024

4. MambaByte: Token-free Selective State Space Model by Junxiong Wang et al. (Cornell University) - 24 Jan. 2024

5. Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling by Pratyush Maini et al. (Apple) - 29 Jan. 2024

6. Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training by Evan Hubinger et al. (Anthropic) - 10 Jan. 2024

7. Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data by Lihe Yang et al. (TikTok) - 19 Jan. 2024

8. Lumiere: A Space-Time Diffusion Model for Video Generation by Omer Bar-Tal et al. (Google Research) - 23 Jan. 2024

9. Solving olympiad geometry without human demonstrations by Dirk Groenveld et al. (Google Deepmind) - 17 Jan. 2024

10. Learning Universal Predictors by Jordi Grau-Moya et al. (Google Deepmind) - 26 Jan. 2024

You can find an annotated collection of these papers, and more, in Zeta Alpha, which allows you to effortlessly discover relevant literature and dive deeper into any of the topics that are close to your interests!

Finally, the full-length recording of our February 2024 Trends in AI webinar is available on YouTube. If you'd prefer a short video overview describing the trending papers, check this out:

To join us live for the next installment of the Trends in AI webinar, make sure to sign up here.