Law
Object Reprojection Error (ORE): Camera pose benchmarks from lightweight tracking annotations
These target videos may vary widely in complexity of scenes, activities, camera trajectory, etc.
TFLEX: Temporal Feature-Logic Embedding Framework for Complex Reasoning over Temporal Knowledge Graph
Reasoning over TKGs has two challenges: 1.
Supplementary File for ConvBench: A Multi-Turn Conversation Evaluation Benchmark with Hierarchical Evaluation Capability for Large Vision-Language Models
We calculate the agreement of human judgment and our automatic evaluation (i.e., ConvBenchEval()) and find it reaches 81.83% (seeing Table 3 - 6 for detailed agreement of each turn of overall). It demonstrates the effectiveness of ConvBenchEval(), which uses ChatGPT. The agreement between ChatGPT and GPT4 is very high at 87.38%. It demonstrates that using different LLMs as judges slightly influences the evaluation results. ConvBenchEval() armed with ChatGPT can is reliable and low-cost. From the above tables, we also observe that though GPT4V is expensive and can capture images, its judgment performs worse than GPT4's judgment.
Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Making Manling Li
We aim to evaluate Large Language Models (LLMs) for embodied decision making.
Bias in Evaluation Processes: An Optimization-Based Model L. Elisa Celis Y ale University Amit Kumar IIT Delhi Anay Mehrotra Y ale University Nisheeth K. Vishnoi Y ale University
In these processes, an evaluator estimates an individual's value to an institution.