467
edits
Changes
no edit summary
== Prismatic REPL Script Guide == Here are some suggestions to run the generate.py REPL Script from the repo (you can find this in the '''scripts''' folder) if you would like to get started with OpenVLA.
== Prerequisites ==
Make sure the images have an end effector in them.
[[File:Coke can2.png|400px|Can pickup task]]
You should see this in your terminal:
[[File:Openvla1.png|800px|openvla prismatic models]]
''After loading the model, the script enters a REPL mode, allowing the user to interact with the model. The REPL mode provides a default generation setup and waits for user inputs.''
Basically, the generate.py script runs a REPL that allows users to interactively test generating outputs from the Prismatic model prism-dinosiglip+7b. Upon running the script, users can enter commands in the REPL prompt:
type (i) to load a new local image by specifying its path, ''work in progress(p) to update the prompt template for generating outputs,need (q) to add screenshots quit the REPL, or directly input a prompt to generate a response based on the loaded image and next steps''the specified prompt. [[File:Prismatic chat1.png|800px|prismatic chat]]