DiagramNet introduces a new dataset and end-to-end framework for recognizing non-standard system-level diagrams, a hard multimodal problem in chip and hardware design. It matters because structured diagram understanding is a bottleneck for turning engineering schematics into machine-readable representations.
arXiv:2605.01338v1 Announce Type: new Abstract: System-level diagrams encode the architectural blueprint of chip design, specifying module functions, dataflows, and interface protocols. However, non-standardized symbols and the scarcity of structured training data hinder existing multimodal large language models (MLLMs) from recognizing these diagrams. To address this gap, we introduce DiagramNet, the first multimodal dataset for system-level diagrams, comprising 10,977 connection annotations…