René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"mitmproxy mode local doesn't work in mitmproxy-java","articleBody":"**Env:** \nJava 17, \nmitmproxy 11.1.3, \nmitmproxy-java: 2.0.2\nmacOS 15.3.1\n\n**Steps:**\n1) Run `mitmweb --mode local `\n2) Accept all permissions for Mitmproxy Redirector\n3) Close mitmweb\n4) Start mitmproxy through Java tests\n\n```\n    @Step(\"Start Mitmproxy on port {portNumber}\")\n    public static void startMitmproxyOnPort(Integer portNumber) {\n            List\u003cInterceptedMessage\u003e messages = new ArrayList\u003cInterceptedMessage\u003e();\n\n            List\u003cString\u003e extraMitmproxyParams;\n                 extraMitmproxyParams = Arrays.asList(\n                         \"--mode\", \"local\",\n                         \"--showhost\"\n                 );\n            extraMitmproxyParams = extraMitmproxyParams.stream().filter(str -\u003e !str.isEmpty()).collect(Collectors.toList());\n\n            ReporterUtil.log(\"Mitmproxy parameters: \", extraMitmproxyParams.toArray(String[]::new));\n            mitmproxyJava = new MitmproxyJava(config().mitmdumpPath(), (InterceptedMessage m) -\u003e {\n                System.out.println(\"intercepted request for \" + m.getRequest().getUrl());\n                messages.add(m);\n                return m;\n            }, portNumber, extraMitmproxyParams);\n\n            try {\n                ReporterUtil.log(\"Start Mitmproxy\");\n                mitmproxyJava.start();\n                ReporterUtil.log(\"Mitmproxy is started\");\n            } catch (Exception e) {\n                e.printStackTrace();\n                ReporterUtil.log(\"Cannot start mitmproxy\");\n                throw new RuntimeException(e);\n            }\n    }\n```\n\n**Obtained result:**\n\n```\n[main] WARN com.codeborne.selenide.logevents.SelenideLogger - No listeners found for thread '1'\n[main] INFO com.tunein.mobile.utils.ReporterUtil - Mitmproxy parameters: \n[main] INFO com.tunein.mobile.utils.ReporterUtil - --mode\n[main] INFO com.tunein.mobile.utils.ReporterUtil - local\n[main] INFO com.tunein.mobile.utils.ReporterUtil - -vvv\n[main] INFO com.tunein.mobile.utils.ReporterUtil - --showhost\n[main] INFO com.tunein.mobile.utils.ReporterUtil - Start Mitmproxy\n[main] INFO io.appium.mitmproxy.MitmproxyJava - Starting mitmproxy on port 8089\n[WebSocketSelector-34] INFO org.java_websocket.server.WebSocketServer - websocket server started successfully\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - Error logged during startup, exiting...\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.509] Using existing mitmproxy redirector app.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.514] Initializing macOS proxy ...\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.515] Starting redirector app...\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] = connection is CONNECTING\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e GET / HTTP/1.1\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Host: localhost:8765\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Upgrade: websocket\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Connection: Upgrade\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Sec-WebSocket-Key: /23BzkBekmaCjx244lhJMg==\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Sec-WebSocket-Version: 13\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e Sec-WebSocket-Extensions: permessage-deflate; client_max_window_bits\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.533] \u003e User-Agent: Python/3.12 websockets/12.0\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c HTTP/1.1 101 Web Socket Protocol Handshake\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c Connection: Upgrade\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c Date: Tue, 18 Feb 2025 13:41:12 GMT\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c Sec-WebSocket-Accept: SPonIP1a6+vBH3kyquqeDIKQmFg=\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c Server: TooTallNate Java-WebSocket\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003c Upgrade: websocket\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] = connection is OPEN\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.547] \u003e PING c1 cd 76 f3 [binary, 4 bytes]\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.575] Redirector app exited successfully.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.576] Waiting for control channel...\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.636] Control channel connected.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.636] macOS proxy successfully initialized.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.637] Local redirector started.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.729] Python interoperability task shutting down.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - [15:41:12.730] Task failed: macOS System Extension shut down.\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - disabled backtrace\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - Error in sys.excepthook:\n[Thread-13] INFO io.appium.mitmproxy.MitmproxyJava - Original exception was:\njava.util.concurrent.TimeoutException: Timed out waiting for mitmproxy to start\n\tat io.appium.mitmproxy.MitmproxyJava.waitForPortToBeInUse(MitmproxyJava.java:138)\n\tat io.appium.mitmproxy.MitmproxyJava.start(MitmproxyJava.java:84)\n\tat com.tunein.mobile.mitmproxy.MitmproxyDriverProvider.startMitmproxyOnPort(MitmproxyDriverProvider.java:260)\n\tat com.tunein.BaseTest.beforeSuite(BaseTest.java:46)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:568)\n\tat org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:141)\n\tat org.testng.internal.invokers.MethodInvocationHelper.invokeMethodConsideringTimeout(MethodInvocationHelper.java:71)\n\tat org.testng.internal.invokers.ConfigInvoker.invokeConfigurationMethod(ConfigInvoker.java:400)\n\tat org.testng.internal.invokers.ConfigInvoker.invokeConfigurations(ConfigInvoker.java:333)\n\tat org.testng.SuiteRunner.privateRun(SuiteRunner.java:358)\n\tat org.testng.SuiteRunner.run(SuiteRunner.java:312)\n\tat org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)\n\tat org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:95)\n\tat org.testng.TestNG.runSuitesSequentially(TestNG.java:1274)\n\tat org.testng.TestNG.runSuitesLocally(TestNG.java:1208)\n\tat org.testng.TestNG.runSuites(TestNG.java:1112)\n\tat org.testng.TestNG.run(TestNG.java:1079)\n\tat com.intellij.rt.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:66)\n\tat com.intellij.rt.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:109)\n[main] INFO com.tunein.mobile.utils.ReporterUtil - Cannot start mitmproxy\njava.lang.RuntimeException: java.util.concurrent.TimeoutException: Timed out waiting for mitmproxy to start\n\tat com.tunein.mobile.mitmproxy.MitmproxyDriverProvider.startMitmproxyOnPort(MitmproxyDriverProvider.java:265)\n\tat com.tunein.BaseTest.beforeSuite(BaseTest.java:46)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:568)\n\tat org.testng.internal.invokers.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:141)\n\tat org.testng.internal.invokers.MethodInvocationHelper.invokeMethodConsideringTimeout(MethodInvocationHelper.java:71)\n\tat org.testng.internal.invokers.ConfigInvoker.invokeConfigurationMethod(ConfigInvoker.java:400)\n\tat org.testng.internal.invokers.ConfigInvoker.invokeConfigurations(ConfigInvoker.java:333)\n\tat org.testng.SuiteRunner.privateRun(SuiteRunner.java:358)\n\tat org.testng.SuiteRunner.run(SuiteRunner.java:312)\n\tat org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)\n\tat org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:95)\n\tat org.testng.TestNG.runSuitesSequentially(TestNG.java:1274)\n\tat org.testng.TestNG.runSuitesLocally(TestNG.java:1208)\n\tat org.testng.TestNG.runSuites(TestNG.java:1112)\n\tat org.testng.TestNG.run(TestNG.java:1079)\n\tat com.intellij.rt.testng.IDEARemoteTestNG.run(IDEARemoteTestNG.java:66)\n\tat com.intellij.rt.testng.RemoteTestNGStarter.main(RemoteTestNGStarter.java:109)\nCaused by: java.util.concurrent.TimeoutException: Timed out waiting for mitmproxy to start\n\tat io.appium.mitmproxy.MitmproxyJava.waitForPortToBeInUse(MitmproxyJava.java:138)\n\tat io.appium.mitmproxy.MitmproxyJava.start(MitmproxyJava.java:84)\n\tat com.tunein.mobile.mitmproxy.MitmproxyDriverProvider.startMitmproxyOnPort(MitmproxyDriverProvider.java:260)\n\t... 19 more\n```\n","author":{"url":"https://github.com/olezvinskyi","@type":"Person","name":"olezvinskyi"},"datePublished":"2025-02-18T13:38:11.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/23/mitmproxy-java/issues/23"}