Using Groundlight on the edge

Starting your model evaluations at the edge reduces latency, cost, network bandwidth, and energy. Once you have downloaded and installed your Groundlight edge models, you can configure the Groundlight SDK to use your edge environment by configuring the 'endpoint' which the SDK connects to. You can do this either directly in code as such:

from groundlight import Groundlight
gl = Groundlight(endpoint="http://localhost:6717")

or by setting the GROUNDLIGHT_ENDPOINT environment variable like:

export GROUNDLIGHT_ENDPOINT=http://localhost:6717
python your_app.py

(Edge model download is not yet generally available. Work with your Solutions Engineer to set up edge inference.)