川师大杀人案
Chinese team develops intelligent vision sensor that turns light signals into AI-ready tokens, reducing use of energy_我的网站
一 | 近日，我省商洛市柞水县、镇安县、商州区遭遇持续强降雨引发的严重洪涝灾害 ，群众生产生活受到极大影响。
The new ultra-low-power intelligent vision sensor chip "LightTok" developed by a research team from Nanjing University. Photo: from Science and Technology Daily
A Chinese research team from Nanjing University has developed a new ultra-low-power intelligent vision sensor chip, dubbed "LightTok," that can convert light signals into tokens within the sensor, significantly reducing the high energy consumption caused by frequent transfers of massive amounts of redundant data, the principal investigator told the Global Times.
According to a release from the Institute of Brain-Inspired Intelligence of Nanjing University, tokens generated by the LightTok chip can be directly fed into a Transformer encoder for image recognition.
"Our design idea was to move token generation onto the sensor itself, allowing the chip to directly produce tokens that AI models can process once light reaches the sensor," Miao Feng, director of the Institute of Brain-Inspired Intelligence at Nanjing University, told the Global Times on Thursday. "These tokens contain complete image information."
Physical AI refers to intelligent systems capable of autonomously perceiving, reasoning, acting and receiving feedback in the real world, representing a key pathway for AI to move from the digital realm into the physical world. Vision-based physical AI systems powered by large AI models need to convert visual information from real-world environments into tokens that can be processed by AI models before feeding these tokens into Transformers for subsequent tasks.
In traditional visual perception pipelines, light signals must go through multiple stages, including image sensing, analog-to-digital conversion, data buffering and transfer, digital image patching and embedding, before being transformed into tokens that AI models can process. The frequent transfer of massive amounts of redundant data has resulted in high energy consumption at the edge, according to a report by Science and Technology Daily.
The LightTok chip directly addresses a key challenge in physical AI hardware: how to efficiently acquire and tokenize visual information from the physical world with low energy consumption, Miao said.
The LightTok chip consists of a photosensitive memory array and peripheral circuits. The team built the array based on single-layer molybdenum disulfide (MoS₂) floating-gate phototransistors, with each pixel capable of sensing light, storing information and performing analog computing. By processing optical information directly within the chip, the device can convert captured visual signals into tokens for AI models, according to the research team.
The current LightTok prototype has a resolution of 32×32 pixels, or 1,024 photosensitive pixels, which is still smaller than that of smartphone cameras and industrial imaging systems. However, Miao said the technology is compatible with CMOS manufacturing processes and can be scaled up. With wafer-level growth of molybdenum disulfide materials, the chip could potentially achieve a scale comparable to existing imaging devices.
Miao said the chip also draws inspiration from the information-processing mechanism of human vision. Similar to how the retina extracts key visual information before transmitting it to the brain, the chip also aims to process visual information at an early stage.
The research was conducted in collaboration with another research team from the National University of Singapore. The findings were published on Wednesday in Nature Sensors, an internationally renowned journal in the field of sensing technology, according to the release.
Potential applications for LightTok include drone systems, autonomous remote sensing and small-scale embodied AI systems, Miao said. In these scenarios, devices need to continuously detect, understand and track targets, generating massive amounts of visual data. By reducing the energy required for visual processing, the technology could extend the operating time of drones, satellites and small robots with limited power supplies, the expert said.
。
二 | 陕西省体彩中心紧急部署救灾帮扶工作，8月11日至12日，体彩的物资捐赠车辆奔赴受灾一线，以实际行动践行公益初心，用实实在在的行动诠释国家公益彩票的使命与温度，为灾区群众送去温暖与力量。8月11日，陕西体彩捐赠队连夜赶赴灾情最为严重的柞水县杏坪镇和镇安县大坪镇，为灾区群众送去应急帐篷、棉被、铁锨、雨靴等应急保障用品，以及矿泉水、泡面、大米、面粉、桶装食用油等生活必需品。
三 | 次日，队伍继续前往商州区受灾严重的杨斜镇郭湾村，完成最后一批赈灾物资的交接，确保爱心覆盖每一处亟需救助的角落。 捐赠现场，受灾群众和当地镇村干部无不感怀于心，纷纷为陕西体彩的快速响应和务实作风点赞。他们表示，这批物资不仅解了燃眉之急，更在艰难时刻传递了社会的温情与力量，为抗洪抢险和后续安置工作注入了坚实底气。
四 | 多年来，陕西体彩始终秉持“来之于民，用之于民”的发行宗旨，将公益触角延伸至急难险重的第一线。此次驰援商洛，既是一次应急救助的高效行动，更是体彩社会责任感的生动映照——从赛场到灾区，从助力全民健身到守护生命安康，陕西体彩始终与三秦儿女风雨同舟，以公益之光照亮困境，以担当之责温暖民心。未来，陕西体彩将继续筑牢责任基石，在服务民生、回馈社会的道路上笃行不怠，为谱写陕西高质量发展新篇章贡献更多体彩力量。
Current article:http://eez2ngj.senbatuqiuzhuanlanrilao.sbs/egyu3/20260826/688620.html
Published on:16:15:59
