New On-Device AI Filing System: Can Open Source Communities Benefit?
A couple of days ago, I saw news in a community group chat: someone spent two days forcing a distilled 7B model onto an old Qualcomm Snapdragon 865 phone. The running speed was abysmal, but at least it worked. The group cheered, and then someone asked: Can this thing pass filing/registration? What if it gets treated as an "unregistered generative AI service"? Everyone laughed at the time, thinking filing was for commercial products and had nothing to do with individual developers playing with models. Until today, when I saw OPPO's AndesGPT obtain edge-side generative AI service registration, I suddenly realized that the compliance process for edge AI is moving much faster than imagined, and the impact on the open-source community might be double-edged.
Physix Frontier