alibaba / alibaba/anyproxy

抓取一个APP失败案例

Open
#453 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
7.9k
Forks
1.2k
PR merge metrics
No merged PRs in 30d

Description

希望了解具体怎么调试这个问题。

#### Which platform are you running AnyProxy
Mac 10.14

#### The version of the AnyProxy
4.0.12

#### Your expected behavior of AnyProxy
运行 anyproxy -i --ws-intercept 启动的服务
EWA - English speaking course by LEARNING ENGLISH LAB PTE LTD
可以抓取到应用内的网络访问

#### The actual behavior of AnyProxy
应用停止在开机页面,抓取到的请求都是CONNECT的类型。
证书安装到了login和system里,也选了always trust
虽然每次启动都还是会报ROOT CA NOT INSTALLED YET。但其他应用,如Twitter,Google这样HTTPS的网页都可以打开抓取到body,应该证明证书安装成功了吧?

#### The log of the error

后台看到的是这样的
[后台截图](https://shimo.im/docs/OvqpfqGb5fAsHXCv/)
会有一些类似api.appewa.com,graph.facebook.com的部分是灰色的。

$ anyproxy -i --ws-intercept
[AnyProxy WARN][2018-12-25 16:05:00]: ROOT CA NOT INSTALLED YET
? The rootCA is not trusted yet, install it to the trust store now? Yes
[AnyProxy Log][2018-12-25 16:05:06]: About to trust the root CA, this may requires your password
Password:
[AnyProxy Log][2018-12-25 16:05:09]: Root CA install, you are ready to intercept the https now
[AnyProxy Log][2018-12-25 16:05:09]: The root CA file path is: /Users/xxx/.anyproxy/certificates/rootCA.crt
[AnyProxy Log][2018-12-25 16:05:09]: Http proxy started on port 8001
[AnyProxy Log][2018-12-25 16:05:09]: web interface started on port 8002
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request gate.hockeyapp.net
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for gate.hockeyapp.net established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request sentry.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for sentry.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request www.gstatic.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for www.gstatic.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request play.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for play.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request p52-buy.itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for p52-buy.itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request device-provisioning.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for device-provisioning.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request device-provisioning.googleapis.com
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for device-provisioning.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:14]: received https CONNECT request itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:14]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:14]: [internal https]proxy server for itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request itunes.apple.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for itunes.apple.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request t.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for t.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api2.branch.io
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api2.branch.io established
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request events.appsflyer.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for events.appsflyer.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request cloudconfig.googleapis.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for cloudconfig.googleapis.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request api.appewa.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for api.appewa.com established
[AnyProxy Log][2018-12-25 16:05:15]: received https CONNECT request ssl.google-analytics.com
[AnyProxy Log][2018-12-25 16:05:15]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:15]: [internal https]proxy server for ssl.google-analytics.com established
[AnyProxy Log][2018-12-25 16:05:29]: received https CONNECT request graph.facebook.com
[AnyProxy Log][2018-12-25 16:05:29]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:29]: [internal https]proxy server for graph.facebook.com established
[AnyProxy Log][2018-12-25 16:05:30]: received https CONNECT request app-measurement.com
[AnyProxy Log][2018-12-25 16:05:30]: received https CONNECT request gate.hockeyapp.net
[AnyProxy Log][2018-12-25 16:05:30]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:30]: [internal https]proxy server for app-measurement.com established
[AnyProxy Log][2018-12-25 16:05:30]: will forward to local https server
[AnyProxy Log][2018-12-25 16:05:30]: [internal https]proxy server for gate.hockeyapp.net established

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the report on Mac 10.14 with AnyProxy 4.0.12 and `anyproxy -i --ws-intercept`, using the EWA application and the listed CONNECT logs. Trace the HTTPS interception flow from the observed CONNECT requests and compare it with the stated successful behavior for Twitter and Google. Done means identifying a specific cause or missing diagnostic for EWA’s stalled startup and documenting a reproducible conclusion.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
backend, networking
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.