Goto

Collaborating Authors

 Deep Learning


12e35d9186dd72fe62fd039385890b9c-Paper.pdf

Neural Information Processing Systems

Although tremendous success has been achieved in spatial and network representation separately in recent years, there exist very little works on the representation of spatial networks. Extracting powerful representations from spatial networks requires the development of appropriate tools to uncover the pairing of both spatial and network information in the appearance of node permutation invariant, and rotation and translation invariant. Hence it can not be modeled merely with either spatial or network models individually. To address these challenges, this paper proposes a generic framework for spatial network representation learning. Specifically, a provably information-lossless and rotation-translation invariant representation of spatial information on networks is presented. Then a higher-order spatial network convolution operation that adapts to our proposed representation is introduced. To ensure efficiency, we also propose a new approach that relied on sampling random spanning trees to reduce the time and space complexity fromO(N3) to O(N).




13e36f06c66134ad65f532e90d898545-Paper.pdf

Neural Information Processing Systems

Recently, a provocative claim was published that number sense spontaneously emerges in a deep neural network trained merely for visual object recognition. This has, if true, far reaching significance to the fields of machine learning and cognitivesciencealike.





Ultra-LowPrecision4-bitTrainingofDeepNeural Networks

Neural Information Processing Systems

While 8-bit floating point formats appeartobesufficient fortraining [14,19],4-bit gradient representations appear challenging from a quantization error (rounding), precision and dynamic range perspective.



TaskBench: BenchmarkingLargeLanguage ModelsforTaskAutomation

Neural Information Processing Systems

To address this, we introduceTASKBENCH, a comprehensive framework to evaluate the capability of LLMs in task automation. Specifically, task automation can be divided into three critical stages: task decomposition, tool selection, and parameter prediction. To tackle the complexities inherent in these stages, we introduce the concept of Tool Graph to represent decomposed tasksandadoptaback-instruct method togenerate high-quality userinstructions. We propose TASKEVAL, a multi-faceted evaluation methodology that assesses LLMperformance across thesethreestages.