ã¹ãã€æ ç»ãçŸå®ã«ïŒé«æ§èœããŠã¹ã®æå€ãªè匱æ§
ìë íì ê²ëŒïŒãããœãã㯠ã³ãã¯ãæ ªåŒäŒç€Ÿã¯ã©ãŠããœãªã¥ãŒã·ã§ã³éšã®å è³ã§ãã
ãé£ã®å®¢ã¯ããæ¿é£ã客ã ã
ããããªããä»ãPCã®åã§ããåãããšãããããã®å£°ã¯èª°ã«èãããŠããã§ããããïŒ
ãã¡ãã誰ã«ãèãããŠããªãâŠãšæããããããªããæ¡ã£ãŠãããã®å
åŠåŒããŠã¹ã«çèŽãããŠãããããããŸããã
ãããªããŸãã§ã¹ãã€æ ç»ã®ãããªè©±ãçŸå®ã®è åšãšããŠç€ºãããè¡æçãªè«æãarXivã«æçš¿ãããŸãããInvisible Ears at Your Fingertips: Acoustic Eavesdropping via Mouse Sensors(æå ã«æœãèŠããªãè³ïŒããŠã¹ã»ã³ãµãŒã«ããé³é¿çèŽ)
ãã®èšäºã§ã¯ããã®è«æãææ¡ãããµã€ããã£ãã«æ»æ ãMic-E-Mouseã ããã©ã®ããã«ããŠããŠã¹ãçèŽåšã«å€ããŠããŸãã®ãããã®é©ãã¹ãä»çµã¿ãšæè¡çãªãã€ã³ããåããããã解説ããŸãã
ãã®è«æãäœããããã®ïŒ3è¡ã§ãŸãšã
- çºæ³ãããã: 人ã®å£°ã«ãã£ãŠåŒãèµ·ããããæºã®åŸ®çŽ°ãªæ¯åãã髿§èœãªå åŠåŒããŠã¹ã®ã»ã³ãµãŒã§æ€åºãã
- æå£ãããã: ãã«ãŠã§ã¢ã«ç®¡çè æš©éã¯äžèŠãäžè¬ãŠãŒã¶ãŒæš©éã§ããŠã¹ã®çããŒã¿ãæãåºããé³å£°ã埩å ã§ãã
- 粟床ãããã: æ©æ¢°åŠç¿ãçšããé«åºŠãªãã£ã«ã¿ãªã³ã°ã§ããã€ãºã«åãããä¿¡å·ããæå€§61%ã®ç²ŸåºŠã§é³å£°èªèã«æåãã
æ å€ã§ãããããŒãã³ã°ã»ã³ã¹ããããã§ããããã
æ»æã®ä»çµã¿ïŒãMic-E-Mouseãã¯ã©ã®ããã«ããŠå£°ãèŽãã®ãïŒ
ãã®æ»æã¯ãäžèŠãããšéæ³ã®ããã«æããŸãããç©ççŸè±¡ãšæ å ±åŠçãçµã¿åãããéåžžã«å·§åŠãªãã®ã§ããã¹ãããããšã«èŠãŠãããŸãããã
Step 1: é³å£°ããæ¯åãã«å€ãã
ããªããçºãã声ïŒé³æ³¢ïŒã¯ã空æ°ã ãã§ãªããæºãããŠã¹ããããšãã£ãåºäœã®è¡šé¢ã«ãäŒãããããåŸ®çŽ°ãªæ¯åãåŒãèµ·ãããŸããããã¯ãã©ã€ãäŒå Žã§ã¹ããŒã«ãŒã®åã«ç«ã€ãšäœãéããã®ãšåãåçã§ãã
Step 2: ããŠã¹ã»ã³ãµãŒããæ¯åããæŸã
è¿å¹Žã®ã²ãŒãã³ã°ããŠã¹ãªã©ã«æèŒãããŠãã髿§èœãªå
åŠåŒã»ã³ãµãŒã¯ãéåžžã«é«ãDPIïŒè§£å床ïŒãšããŒãªã³ã°ã¬ãŒãïŒå ±åé »åºŠïŒãèªããŸãã
å
·äœçã«ã¯ã人ã®å£°ã®äž»æåã§ããæ°çŸHzã®åšæ³¢æ°ãåŒãèµ·ããæºã®åŸ®çŽ°ãªæ¯åïŒæ°ãã€ã¯ãã¡ãŒãã«ïŒã«å¯ŸããäŸãã°16000 DPIã®ããŠã¹ã¯çè«äžçŽ1.6ãã€ã¯ãã¡ãŒãã«ã®åããŸã§èå¥å¯èœã§ãã
ããã«ãããããŠã¹ãæ¬æ¥æ€åºå¯Ÿè±¡ãšããŠããªã ã衚é¢ã®åŸ®çŽ°ãªæ¯åã ãŸã§ãã座æšã®åŸ®å°ãªãã¬ãšããŠæããŠããŸãã®ã§ãã
ã€ãŸããããŠã¹ã¯æå³ããããŠãæºã®è¡šé¢ãäŒããé³é¿æ¯åãæŸããå é床ã»ã³ãµãŒãããå°éèšãã®ããã«æ©èœããŠããŸããŸãã
Step 3: ããŒã¿ãæãåºã
ãããæãæãããç¹ã§ããå€ãã®OSã§ã¯ãã¢ããªã±ãŒã·ã§ã³ãããŠã¹ã®åãïŒraw inputïŒã«ã¢ã¯ã»ã¹ããã®ã«ãç¹å¥ãªç®¡çè æš©éã¯å¿ èŠãããŸããã
æ»æè ã¯ãäžèŠç¡å®³ãªã¢ããªã±ãŒã·ã§ã³ïŒäŸ: ãŠãŒãã£ãªãã£ãœãããã²ãŒã ã®MODãªã©ïŒã«ã³ãŒããä»èŸŒãã ãã§ããã®åŸ®çŽ°ãªæ¯åããŒã¿ãåéããã€ã³ã¿ãŒãããçµç±ã§å€éšã®ãµãŒããŒã«éä¿¡ã§ããŠããŸããŸãããŠãŒã¶ãŒã¯ãããŠã¹ãå°ãã¬ã¯ã€ããªãçšåºŠã«ããæããªããããããŸããã
æå€§ã®å£ãšãªã課é¡: ãã€ãºã ããã®ä¿¡å·ããã©ããã£ãŠé³å£°ã埩å ããã®ãïŒ
ãããããã®æ»æãå®çŸããã«ã¯ã極ããŠé«ãããŒãã«ãååšããŸããããŠã¹ã»ã³ãµãŒãæŸãããŒã¿ã¯ãé³å£°ãã®ãã®ã§ã¯ãªããç®çã®ä¿¡å·ã倧éã®ãã€ãºã«åããããæ±ããããŒã¿ãã ããã§ãã
è«æã«ããã°ãäž»ã«ä»¥äžã®3ã€ã®æè¡ç課é¡ããããŸãã
- äžåäžãªãµã³ããªã³ã°
é³å£°ä¿¡å·ãæ£ããããžã¿ã«åããã«ã¯ãäžå®ã®ééïŒãµã³ããªã³ã°åšæ³¢æ°ïŒã§é³ãèšé²ããå¿ èŠããããŸããããããããŠã¹ã¯åããŠããæããããŒã¿ãéããªããããèšé²ééããã©ãã©ã«ãªããŸãããã®ãæéè»žã®æªã¿ãã¯ãé³å£°æ³¢åœ¢ãæ£ãã埩å ããäžã§èŽåœçãªé害ãšãªããŸãã
- éç·åœ¢ãªåšæ³¢æ°å¿ç
髿§èœãªãã€ã¯ã¯ã人éã®å¯èŽåã®åšæ³¢æ°ãåäžã«æããããã«èšèšãããŠããŸããäžæ¹ãããŠã¹ã»ã³ãµãŒã¯é³é¿çšã§ã¯ãªããããç¹å®ã®åšæ³¢æ°åž¯ããæŸãããåšæ³¢æ°ããšã®æåºŠããã©ãã©ã§ããããã«ãããå ã®é³å£°ãšã¯äŒŒãŠã䌌ã€ããªããèããæªãã ä¿¡å·ãçæãããŠããŸããŸãã
- éååãã€ãº
ã»ã³ãµãŒã®è§£å床ã«ã¯éçããããŸããæºã®åŸ®çŽ°ãªæ¯åã¯ãã»ã³ãµãŒãèå¥ã§ããæå°åäœïŒäŸïŒ1.6ãã€ã¯ãã¡ãŒãã«ïŒã«æºããªãå ŽåãåãæšãŠãããããç²ãããžã¿ã«å€ã«äžžãããããããŸãããã®éçšã§çºçããéååãã€ãºãããã ã§ãã埮匱ãªé³å£°ä¿¡å·ãããã«æ±æããŸãã
ãã®çµ¶æçãšãæããç¶æ³ãæç Žãããããç ç©¶è ãã¡ã¯è€æ°ã®ä¿¡å·åŠçæè¡ãçµã¿åããããé«åºŠãªããŒã¿ãã£ã«ã¿ãªã³ã°ãã€ãã©ã€ã³ãæ§ç¯ããŸããã
ãã®äžã§ãç¹ã«åŒ·åãªã®ããEncoder-only Spectrogram Neural Filteringãšããæ·±å±€åŠç¿ãçšããææ³ã§ãããŸãé³å£°ä¿¡å·ãã¹ãã¯ããã°ã©ã ïŒé³ã®åšæ³¢æ°æåãæéå€åãšå ±ã«å¯èŠåããç»åïŒã«å€æããŸããæ¬¡ã«ããæ£åžžãªé³å£°ã®ã¹ãã¯ããã°ã©ã ãæã€ãã¿ãŒã³ããäºååŠç¿ãããã¥ãŒã©ã«ãããã¯ãŒã¯ãçšããŠããã€ãºã«æ±æãããã¹ãã¯ããã°ã©ã ãããã€ãºæåã ããèå¥ããé€å»ããŸãã
ããã¯ãããã°ãé³å£°ã®æçŽããç¥ãå°œãããAIéå®å£«ãã倧éã®ã¬ã©ã¯ã¿ã®äžããæ¬ç©ã®é³å£°ããŒã¿ã ãã粟å¯ã«èŠã€ãåºããããªåŠçã§ããããã®æ»æã®å®çŸæ§ãé£èºçã«é«ããéµãšãªããŸããã
å®éšçµæïŒæ¬åœã«èãåããã®ïŒ
è«æã®å®éšçµæã¯è¡æçã§ãã
- ä¿¡å·å質ã®åäž: ææ¡ææ³ã«ãããä¿¡å·å¯Ÿé鳿¯ïŒSNRïŒãæå€§ã§+19dBãæ¹åããŸãããããã¯ãéšé³ã®äžãã人ã®å£°ãã¯ãªã¢ã«æµ®ãã³äžããããã»ã©ã®å¹æã§ã
- é³å£°èªè粟床: æšæºçãªé³å£°ããŒã¿ã»ããïŒAudioMNIST, VCTKïŒã䜿ã£ãŠåŸ©å ããé³å£°ã§ãã¹ããããšãããçŽ42%ã61%ã®ç²ŸåºŠã§åèªãèªèããããšã«æåããŸãã
61%ãšèããšäœãæãããããããŸããããã©ã³ãã ã«åœãŠã確çããé¥ãã«é«ããäŒè©±ã®ããŒã¯ãŒããå å®¹ãæšæž¬ããã«ã¯ååãªç²ŸåºŠã§ãããã©ã€ãã·ãŒã«é¢ããäŒè©±ãæŒæŽ©ãããªã¹ã¯ãèãããšã決ããŠç¡èŠã§ããªãæ°åã§ãã
ãã®ç ç©¶ã瀺ãæèš
ãMic-E-Mouseãã¯ã身è¿ãªããã€ã¹ãæãã¬åœ¢ã§ã»ãã¥ãªãã£ããŒã«ã«ãªãããããšã瀺ããéåžžã«éèŠãªç ç©¶ã§ãããã®æ»æã¯ãç§ãã¡ã«ããã€ãã®éèŠãªæèšãäžããŠãããŸãã
- ããŒããŠã§ã¢ã®æå³ãã¬æ©èœ: 髿§èœåã»é«æ©èœåããã»ã³ãµãŒã¯ãèšèšè ãæå³ããªãæ å ±ãååŸããŠããŸããå¯äœçšããæã€å¯èœæ§ããããŸã
- ãµã€ããã£ãã«æ»æã®å€æ§æ§: æ»æè ã¯ãCPUã®é»åæ¶è²»ãé»ç£æ³¢ã ãã§ãªããããŠã¹ã®ãããªå ¥åããã€ã¹ãããæ»æçµè·¯ãšããŠå©çšããŸã
- ãæš©éææ ŒäžèŠãã®ãªã¹ã¯: é«åºŠãªæ»æã¯ãå¿ ããã管çè æš©éãå¿ èŠãšããŸãããäžè¬ãŠãŒã¶ãŒæš©éã§å®è¡ã§ãããã«ãŠã§ã¢ã®è åšãåèªèãããããŸã
ç§ãã¡ã«ã§ããããšãšä»åŸã®å±æ
ã§ã¯ããã®æ°ããªè åšã«å¯ŸããŠãç§ãã¡ã¯ã©ã®ããã«åããã°è¯ãã®ã§ããããã
çŸæç¹ã§ã¯ãé床ã«å¿é ããå¿ èŠã¯ãããŸãããã以äžã®åºæ¬çãªã»ãã¥ãªãã£å¯Ÿçã培åºããããšããçµæçã«ãã®ãããªæ»æãžã®åãã«ããªããŸãã
- ãœãããŠã§ã¢ã®åºæã確èªãã: äžå¯©ãªãŠã§ããµã€ãããããªãŒãœãããããŠã³ããŒãããããæäŸå ãäžæãªããŒã«ã宿ã«ã€ã³ã¹ããŒã«ãããããã®ã¯é¿ããŸããã
- ããã€ã¹ã®æ§èœãšãªã¹ã¯ãçè§£ãã: 髿§èœãªã²ãŒãã³ã°ããŠã¹ãå³åº§ã«å±éºãªããã§ã¯ãããŸããããããããããã€ã¹ã®æå³ãã¬æ©èœããªã¹ã¯ã«ãªãããããšããããšãç¥ã£ãŠããããšã¯ãä»åŸã®ã»ãã¥ãªãã£æèã«ãããŠéèŠã§ã
- OSããœãããŠã§ã¢ãææ°ã«ä¿ã€: å°æ¥ãOSãã³ããŒãã»ã³ãµãŒããŒã¿ãžã®ã¢ã¯ã»ã¹æš©éããã峿 Œã«ç®¡çããå¯èœæ§ããããŸããåžžã«ææ°ã®ã¢ããããŒããé©çšããããšããæªç¥ã®è匱æ§ãã身ãå®ãããã®äžå©ãšãªããŸã
ãã®ç ç©¶ã¯ãå°æ¥ã®ããŠã¹ãOSã®èšèšè ã«å¯Ÿãããã»ã³ãµãŒããŒã¿ãžã®ã¢ã¯ã»ã¹æš©éããã峿 Œã«ç®¡çãã¹ãã§ã¯ãªããïŒããšããéèŠãªåããæããããŠããŸãã
ç§ãã¡ã®èº«ã®åãã®ããããã¢ããã»ã³ãµãŒãšãªãã€ã³ã¿ãŒãããã«ç¹ããIoTæä»£ã
䟿å©ãã®è£ã«æœãæ°ããªãªã¹ã¯ã«ãç§ãã¡ã¯ãã£ãšææã«ãªãå¿
èŠãããã®ãããããŸããã
ãæã
èšäºå
容ã¯å人ã®èŠè§£ã§ãããæå±çµç¹ã®ç«å ŽãæŠç¥ã»æèŠã代衚ãããã®ã§ã¯ãããŸããã
ãããŸã§ãšã³ãžãã¢ãšããŠã®çµéšãèããçºä¿¡ããŠããŸãã®ã§ããäºæ¿ãã ããã