Massive Text Embedding Benchmark (MTEB) is anNLP benchmark for embedding style models.

They have a public MTEB Leaderboard which shows downstream performance at a number of tasks using the embeddings generated by the models under evaluation.