René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"[Feature]: Add tools to toggle iOS Simulator software keyboard and hardware keyboard connection","articleBody":"### Feature Description\n\nExpose the iOS Simulator's two keyboard menu actions as MCP tools:\n\n- `toggle_software_keyboard` — equivalent to `Simulator → I/O → Keyboard → Toggle Software Keyboard` (⌘K). Shows/hides the on-screen software keyboard.\n- `toggle_connect_hardware_keyboard` — equivalent to `Simulator → I/O → Keyboard → Connect Hardware Keyboard` (⇧⌘K). Toggles whether the simulator receives input from the Mac's hardware keyboard.\n\nNeither action is currently available through XcodeBuildMCP. Both are menu-level Simulator.app operations with no direct `xcrun simctl` equivalent, so an agent cannot reach them without driving Simulator.app via AppleScript/accessibility — which is exactly the kind of glue MCP should provide.\n\n### Use Cases\n\n- UI automation / UI tests where the software keyboard must be visible for `tap`-based text entry. With \"Connect Hardware Keyboard\" on (default), tapping a text field does not bring up the software keyboard, which breaks scripted flows that rely on tapping individual keys.\n- Reproducing layout bugs that only occur when the software keyboard is visible (e.g. `keyboardWillShow` adjustments, safe-area insets, scroll-to-input behavior).\n- Recording screenshots/videos that must include the software keyboard.\n- Switching a simulator between \"developer typing on Mac keyboard\" and \"end-user typing on touch keyboard\" without manually navigating menus.\n\n### Example Interactions\n\n```\nYou:  Open the notes app in the booted simulator, make the software keyboard appear, and take a screenshot showing it.\nAI:   (boots/focuses sim) → toggle_connect_hardware_keyboard(simulatorUuid)\n                          → tap on the note text field\n                          → screenshot()\n\nYou:  I'm testing keyboardWillShow adjustments. Make sure the hardware keyboard is disconnected so the software keyboard actually appears.\nAI:   toggle_connect_hardware_keyboard(simulatorUuid) if currently connected.\n\nYou:  Hide the software keyboard so I can see the full view.\nAI:   toggle_software_keyboard(simulatorUuid)\n```\n\n### Notes / open design questions\n\n- Both actions are global to the Simulator.app front window rather than per-device; the tool would focus the requested simulator first, then send the keystroke via AppleScript.\n- Alternative implementation for hardware-keyboard: `defaults write com.apple.iphonesimulator ConnectHardwareKeyboard` — persistent but requires a simulator restart. Leaning toward the AppleScript menu/keystroke approach to match manual user behavior and avoid restart. Happy to go the other way if maintainers prefer.\n- Proposed placement: `src/mcp/tools/simulator-management/` alongside `sim_statusbar` and `set_sim_appearance`, since these are Simulator.app settings rather than in-app UI automation.","author":{"url":"https://github.com/yjmeqt","@type":"Person","name":"yjmeqt"},"datePublished":"2026-04-19T08:50:01.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/346/XcodeBuildMCP/issues/346"}