Proto commits in google-deepmind/android_env

These 35 commits are when the Protocol Buffers files have changed:

Commit:13cfe76
Author:DeepMind
Committer:Copybara-Service

Add option to use uiautomator instead of a11y forwarder app in Android World. PiperOrigin-RevId: 688624140

Commit:3178a22
Author:DeepMind
Committer:Copybara-Service

Fix that UIAutomator may not return output dump on a real device if the device screen is off. PiperOrigin-RevId: 688618828

Commit:f3bc552
Author:DeepMind
Committer:Copybara-Service

Add support for `uiautomator dump` to AndroidEnv. PiperOrigin-RevId: 688616417

Commit:53617fa
Author:Daniel Toyama
Committer:Copybara-Service

Introduce Accessibility Protobuf messages. These messages encode accessibility information coming from Android OS. Actual components that use them will come later. PiperOrigin-RevId: 631531250

The documentation is generated from this commit.

Commit:3e485c1
Author:Daniel Toyama
Committer:Copybara-Service

Internal change. PiperOrigin-RevId: 625727119

Commit:9ff3558
Author:Daniel Toyama
Committer:Copybara-Service

Internal change. PiperOrigin-RevId: 625071559

Commit:cfacf82
Author:Daniel Toyama
Committer:Copybara-Service

Introduce `EmulatorLauncherConfig`. This change introduces a new `dataclass`, `EmulatorLauncherConfig`, to hold several configuration settings for `EmulatorLauncher`. This is yet another move to align how AndroidEnv is initialized externally in its open-source version and in internal Google's systems. PiperOrigin-RevId: 600440895

Commit:93062aa
Author:DeepMind
Committer:Copybara-Service

Send explicit broadcasts to SET_GRPC and ENABLE_A11Y_TREE_LOGS. changes: -add component field to SendBroadcast in AdbRequest -change the send broadcast function in the call parser to pass the component name if present in the request -in the a11y grpc wrapper, set the component name to match FlagsBroadcastReceiver PiperOrigin-RevId: 581358945

Commit:636bfae
Author:Daniel Toyama
Committer:Copybara-Service

Add deprecation notice to `Task.extras_spec`. This field in the task definition proved to be more of a burden than a helpful assist to agents, so we have decided to remove it. It was often wrong and outdated, and it made the system more complex for little gain. PiperOrigin-RevId: 557540601

Commit:c79769d
Author:Daniel Toyama
Committer:Copybara-Service

Define `InstallApk.Blob`. This message should have been exported in the previous CL/529518354 (PR #146) but it was placed in the wrong section in copybara which then caused it to be stripped out. PiperOrigin-RevId: 529704214

Commit:bae3589
Author:DeepMind
Committer:Copybara-Service

Allow users to pass serialized bytes of an apk file to install apk as `InstallApk.Blob`. PiperOrigin-RevId: 529518354

Commit:132b27a
Author:Daniel Toyama
Committer:Copybara-Service

Replace `typing.List` with `builtins.list`. PiperOrigin-RevId: 527078620

Commit:4d5e0a2
Author:Daniel Toyama
Committer:Copybara-Service

Fix `np` scalar conversions. This change removes a few `pytype` escape hatches which break with an upcoming release of PyType. PiperOrigin-RevId: 520400014

Commit:826b419
Author:Daniel Toyama
Committer:Copybara-Service

Remove unused import in `snapshot_service.proto`. PiperOrigin-RevId: 512132951

Commit:8136330
Author:Philippe Hamel
Committer:Copybara-Service

Rollback of breaking change PiperOrigin-RevId: 502968171

Commit:f78d801
Author:Daniel Toyama
Committer:Copybara-Service

Replace `SendBroadcast` with `GenericRequest`. Currently `SendBroadcast` only supports the `action` argument, which prevents using other arguments such as extras or specific components (`-n`). There are a lot of possible arguments (see https://developer.android.com/studio/command-line/adb#IntentSpec) and we could potentially create a message to capture all arguments for intents, and even reuse it when starting an activity, but for now it's better to remove the restriction of only sending actions, and let the client add as many arguments as they want with a `GenericRequest`. PiperOrigin-RevId: 502680791

Commit:4bc51f1
Author:DeepMind
Committer:Copybara-Service

Fix pip import of snapshot protos PiperOrigin-RevId: 502571368

Commit:0dd5f01
Author:Daniel Toyama
Committer:Copybara-Service

Remove `StartIntent`. This message is unused and is a subset of `GenericRequest` anyway. PiperOrigin-RevId: 502440558

Commit:1c1c754
Author:DeepMind
Committer:Copybara-Service

Add functionality to save and load simulator state PiperOrigin-RevId: 495663358

Commit:a37a701
Author:DeepMind
Committer:Copybara-Service

Add objects as a supported `task_extras` type PiperOrigin-RevId: 482010046

Commit:ad00835
Author:DeepMind
Committer:Copybara-Service

Add the ability to send android accessibility broadcast events to android _env PiperOrigin-RevId: 471316804

Commit:217376d
Author:Daniel Toyama
Committer:Daniel Kenji Toyama

Internal change. PiperOrigin-RevId: 465640853

Commit:5162ace
Author:DeepMind
Committer:Daniel Kenji Toyama

[AndroidEnv] Making logcat regexps more flexible. PiperOrigin-RevId: 359835409

Commit:76ea013
Author:DeepMind
Committer:Daniel Kenji Toyama

[AndroidEnv] Add `Task.max_num_steps`. This CL adds support for a task-specific maximum number of steps. This is important when evaluating agents on non-time sensitive tasks because the performance of the emulator varies dramatically across different runs, machines and cluster load. This CL also adds a note to the config-wide "maximum_duration_steps" and "maximum_duration_sec". Notice that it may still be useful to override this setting, but this can be done _outside_ of AndroidEnv in `env_factories.py` for example. PiperOrigin-RevId: 354359520

Commit:e091852
Author:Zafarali Ahmed
Committer:Daniel Kenji Toyama

#AndroidEnv: Hide sensitive comments behind copybara strip statements. Preparation for open sourcing. PiperOrigin-RevId: 352455961

Commit:04fc407
Author:DeepMind
Committer:Daniel Kenji Toyama

Integrate Polytopia in AndroidEnv A few changes are required in AndroidEnv to make Polytopia work. - add a message prefix for log cat This is required because Polytopia log statements have a double tag (e.g. Unity: AndroidRLTask: ), and logcat doesn't support this in the filter-spec, as far as I could figure out. - Add start_intent in adb_controller. The way to start and reset Polytopia is not compatible with start_activity. Also start_activity force stop the app, which we want to avoid. - Add the option to wait for the 'ready' message. A few changes that are not related to Polytopia, but are general improvements: - log adb command outputs, this will be useful for easier debugging of ADB related issues - increase the number of retry for adb connection. It doesn't hurt to spend more time trying in case the machine is slow. - speedup setup_step_interpreter_test by mocking sleep when possible. PiperOrigin-RevId: 350253642

Commit:61f5cfa
Author:DeepMind
Committer:Daniel Kenji Toyama

[AndroidEnv] Move proto schemas to //third_party and change proto package name. This CL moves AndroidEnv `.proto` files from //learning/deepmind/rl/environments/android/ to //third_party/py/android_env/, and it also changes their proto package name from `androidenv` to `android_env` to be consistent with our Python package name (`android_env`). These two changes require changing many `BUILD` deps and Python `import` lines, and it also requires updating the comment on all the `.textproto` files to refer to the new `.proto` location and its updated package name. PiperOrigin-RevId: 350227167

Commit:8d01cbf
Author:DeepMind
Committer:Daniel Kenji Toyama

[AndroidEnv] Initial commit in //third_party/py/android_env/. We will slowly move code from //learning/deepmind/rl/environments/android/ to this directory, then open source it. The approval from DeepMind's side was done in https://buganizer.corp.google.com/issues/175339504. PiperOrigin-RevId: 350174489

This commit does not contain any .proto files.

Commit:4bb8525
Author:Anita Gergely

Latest updates.

Commit:2623502
Author:a-gergely
Committer:GitHub

Fixing proto import.

Commit:66393a7
Author:Anita Gergely

Latest changes in AndroidEnv.

Commit:7094c09
Author:Daniel Kenji Toyama

Initial commit for AndroidEnv. I have made a mistake and (force) pushed a wrong repository into AndroidEnv. I'm force pushing AndroidEnv again from zero to avoid having unrelated code in this repo.

Commit:2a8da07
Author:Anita Gergely

Simplifying logic in different components.

Commit:77b8564
Author:Anita Gergely

Extending log_parsing_config in Task proto messages.

Commit:e46dcf9
Author:Daniel Toyama

Initial commit for AndroidEnv.