3 分鐘講稿
約 380 字,以每分鐘 130 字估算約 2:55。先指到海報區塊再開口。
口語版,不是逐字翻譯;術語保留英文,方便對照海報。先指到海報區塊再開口。
1
0:00–0:30
Hook開場
指:標題 → 右上 Motivation、Fig. 2
指:標題 → 右上 Motivation and Objectives、Fig. 2 機器狗照片
中文
老師好,我是輔大資管的盧柏宇。這是我們的 Unitree Go2 Pro 機器狗。有了 LLM,機器狗可以跟人聊天,還能把一句話變成動作。可是動作做錯是會傷人的,已經有研究把 LLM 控制的機器人,包括 Go2,越獄成做出危險動作。所以我們的目標很直接:把「讓機器人動」的權力從 LLM 手上拿走。
EN
Hi, I'm Po-Yu Lu from Fu Jen Catholic University. This is our Unitree Go2 Pro robot dog. LLMs let a robot like this hold a conversation and turn a sentence into motion. But a wrong motion can hurt someone, and LLM-controlled robots, including a Go2, have already been jailbroken into harmful actions. So our objective is simple: take away the LLM's authority to move the robot.
2
0:30–1:00
Architecture系統架構
指:Fig. 1 由上往下,停在 Interaction core
指:左上 Fig. 1,由上往下 Cloud → Remote GPU → On-board,最後停在 Interaction core 三格
中文
整個系統跑 ROS 2,機上是 8 GB 的 Jetson Orin Nano Super。語言模型和語音合成在雲端,語音辨識放在遠端 GPU 伺服器,感知在機上跑。重點是這一塊互動核心:LLM 只負責提議,Brain 做技能仲裁,Executive 在任何動作送出前先檢查現場狀態。
EN
Here is the system. It runs ROS 2 on an 8 GB Jetson Orin Nano Super. Language models and TTS are in the cloud, speech recognition runs on a remote GPU server, and perception runs on board. The key part is this interaction core: the LLM only proposes, the Brain arbitrates skills, and the Executive checks the world state before any motion is dispatched.
3
1:00–1:50
Methods + backflip demo方法+後空翻示範
指:Methods 技能色條 → backflip 那行
指:左下 Methods 的技能色條(Execute ×5 / Confirm ×2 / Trace only ×2),最後手指停在 backflip 那行
中文
LLM 每次只回一句話,最多提議一個技能,而且只能從九個預先定義好的社交技能裡選。五個直接執行,兩個要對方比 OK 手勢確認,兩個只記錄不動作。聽到「停」這類字,直接跳過 LLM。計畫進佇列之前,Executive 會檢查禁用動作 ID、緊急狀態、障礙物和深度淨空;深度旗標沒回報就當作不安全,也就是 fail-closed。停止類的計畫永遠優先,不會被擋。舉個例子:你叫它後空翻,規則會先口頭婉拒;這個計畫對應到禁用 ID 1301,Executive 直接判 BLOCKED_BY_SAFETY,理由寫 banned_api:1301。
EN
The LLM returns one reply and at most one skill suggestion, from just nine predefined social skills. Five execute directly, two need an OK-gesture confirmation, and two are trace-only. Stop-type words skip the LLM entirely. Before a plan is queued, the Executive checks banned motion IDs, emergency state, obstacles and depth clearance. If the depth flag is not reported, it counts as unsafe. That's fail-closed. And stop plans take priority, so a stop is never blocked. Here's a concrete case. Ask the robot for a backflip. A rule refuses verbally, and its plan maps to banned ID 1301, so the Executive rejects it: BLOCKED_BY_SAFETY, reason banned_api:1301.
4
1:50–2:10
Studio traceStudio 決策追蹤
指:Decision Tracing: Studio、Fig. 3
指:中間右側 Decision Tracing: Studio、Fig. 3 截圖
中文
而且這個判定看得到。在 Studio 操作台,每一筆事件都記下決策 ID、判定結果、哪一道關卡做的決定、理由是什麼。Evidence 頁把它們排成時間線,操作員就能回答:機器人為什麼動、或為什麼沒動。
EN
And you can see that decision. In our Studio console, every event records a decision ID, the verdict, the deciding gate and the reason. The Evidence page turns them into a timeline, so an operator can answer why the robot did or did not move.
5
2:10–2:30
Results結果
指:Fig. 4 → Fig. 5 最下面一條
指:下方中間 Fig. 4 長條(3.76 vs 3.40),再指 Fig. 5 最下面那條 ρ = .70
中文
我們做了 26 人的探索性問卷,大多是看示範影片的學生。智慧感 3.76,比安全感 3.40 高,paired Wilcoxon p = .015。擬人化分數最低,只有 2.96,但它跟整體接受度的相關最強,ρ = .70。
EN
We ran an exploratory survey with 26 people, mostly students who watched a demo. Perceived intelligence, 3.76, was higher than perceived safety, 3.40, paired Wilcoxon p equals .015. Anthropomorphism scored lowest, 2.96, yet it correlated most strongly with overall acceptance, rho .70.
6
2:30–3:00
Conclusion + limits結論與限制
指:右下 Conclusions and Limitations
指:右下 Conclusions and Limitations,依序點三個 bullet
中文
所以,把「提議」和「裁決」拆開,權力邊界就變清楚,決策追蹤再讓這條邊界看得見。限制我們也直接講:還沒有端到端的硬體驗證;語音停止召回率只有 .67,所以不拿來當急停;導航還是要有人監督。下一步,我們要在有人監督的實際互動中,比較「有解釋」和「沉默」的拒絕。謝謝,歡迎提問。
EN
So, separating proposal from adjudication makes the authority boundary explicit, and the trace makes it visible. To be honest about limits: no end-to-end hardware validation yet; voice-stop recall was .67, so speech is not an emergency stop; and navigation stays supervised. Next, we'll compare explained and silent refusals in supervised hands-on use. Thank you, I'm happy to take questions.