ShapeLLM: Universal 3D Object Understanding for Embodied Interaction

Benchmark Model Rank Results
3d-object-captioning-on-objaverse-1ShapeLLM-13B#2GPT-4: 48.94Sentence-BERT: 48.52SimCSE: 49.98
3d-object-captioning-on-objaverse-1ShapeLLM-7B#4GPT-4: 46.92Sentence-BERT: 48.20SimCSE: 49.23
3d-point-cloud-classification-on-modelnet40ReCon++#3Overall Accuracy: 95.0
3d-point-cloud-classification-on-scanobjectnnReCon++#3Overall Accuracy: 95.25OBJ-BG (OA): 98.80OBJ-ONLY (OA): 97.59
3d-point-cloud-linear-classification-onReCon++#2Overall Accuracy: 93.6
3d-question-answering-3d-qa-on-3d-mm-vetShapeLLM-13B#1Overall Accuracy: 53.1
3d-question-answering-3d-qa-on-3d-mm-vetShapeLLM-7B#2Overall Accuracy: 47.4
few-shot-3d-point-cloud-classification-on-1ReCon++#2Overall Accuracy: 98.0Standard Deviation: 2.3
few-shot-3d-point-cloud-classification-on-2ReCon++#1Overall Accuracy: 99.5Standard Deviation: 0.8
few-shot-3d-point-cloud-classification-on-3ReCon++#2Overall Accuracy: 94.5Standard Deviation: 4.1
few-shot-3d-point-cloud-classification-on-4ReCon++#1Overall Accuracy: 96.5Standard Deviation: 3.0
generative-3d-object-classification-on-1ShapeLLM-7B#2Objaverse (Average): 54.50
generative-3d-object-classification-on-1ShapeLLM-13B#4Objaverse (Average): 54.00
generative-3d-object-classification-on-2ShapeLLM-7B#2ModelNet40 (Average): 53.08
generative-3d-object-classification-on-2ShapeLLM-13B#3ModelNet40 (Average): 52.96
zero-shot-transfer-3d-point-cloudReCon++#3Accuracy (%): 87.3
zero-shot-transfer-3d-point-cloud-2ReCon++#1OBJ_ONLY Accuracy(%): 65.4