Feature

🌱Feature 1: Simply Speak Your Command

Simply speak to Watcher, tell it what to watch, and it will notify you when the specified event occurs.

You can easily send commands by Push to Talk or from SenseCraft App.

🌱Feature 2: Understand What it Sees

Running on-device AI models, SenseCAP Watcher can detect different things: people, apples, pets, etc. However, the most outstanding feature of Watcher is its integration with LLMs.

By leveraging LLMs, Watcher can capture precise events you specified, it means going beyond simple target detections, it thoroughly analyzes behaviors and status. Like "dog + playing ball, 0 people + in the room," or "The People + with DHL outfit arrived " etc. Watcher truly understands the scene under its watch!

Constantly calling LLMs like ChatGPT incurs a high cost. Hence, we use the architecture of on-device AI + LLMs. The on-device AI model on Watcher detects the target, which is then analyzed by LLM to generate accurate and actionable insights.

With the task "tell me if the dog is tearing up paper" when the on-device model detects dogs, this keyframe is sent to LLM for further analysis - is it tearing up paper? LLMs won't be triggered by people, cats, squirrel or others. This tremendously reduces LLMs' cost.

🌱Feature 3: Respond via Voice

After detecting the specified event, Watcher can interact with the targets via voice. For example, you can set it this way:

Specified event: someone takes up the pink keyboard;

Specified two reactions: 1) one via voice reply, saying 'Good choice! This is our latest version, inspired by the Pink Royal Typewriter'; 2) the other via a text message to salespersons: 'Someone is interested in the latest keyboard! please go to the shelf ASAP'.

Putting Watcher in different scenarios allows for versatile responses. When seeing a dog tearing up tissues, say “Stop, Cooper!”, when seeing a person smoking in non-smoking areas, say "No smoking!"

🌱Feature 4: Upgrade Your Systems with Just a Simple Plug-in

Once the target event is detected, it can trigger different actions, for example, push messages on SenseCraft App or LED flashes on Watcher. Of course, we understand you want to go beyond the functionalities on the App/ device. No problem at all! There are infinite possibilities for you to explore!

Add Watcher to Home Assistant

Connected to IoT platform like Home Assistant, your Watcher acts as a behavior sensor, activating tailored actions in various contexts. For example, when it detects people, Watcher analyzes the situation and automatically triggers actions: lights on for reading and lights off for sleeping.

More than a vision sensor, Watcher is extendable with other sensors to enable multi-modal sensing. On Watcher's back, the I2C is reserved to accommodate 100+ Grove sensors. This flexibility allows Watcher to integrate a wide range of data sources for thorough analysis and appropriate actions. You will be able to build applications like detect room temperature and adjust the AC accordingly - turn it to 22°C when you're in suits, or 26°C in shorts.

Add Watcher to your Node-RED flow

Just 3 blocks away, you can stream the detected results from your Watcher to any place on the internet via Node-RED, as easy as making a snap!

Add Watcher to your Arduino | ESP32 and other hardware systems

Wanna add an AI agent to popular MCUs and SBCs such as Arduino/ ESP32/ Raspberry Pi? Simply connect it to Watcher via UART or HTTP or USB, and you can explore the new frontier of intelligence.

🌱Feature 5: Give Your Watcher Unique Emotions

SenseCAP Watcher adapts to your commands with unique "modes." It is LISTENING to your instructions, then shifts to WATCHING mode to safeguard your designated space, etc. But the fun doesn't stop here! You can upload your own designs of emotions to give your Watcher a unique personality. Get a PNG file ready and upload it to Watcher within seconds! It is your call!

Watcher's default emojis are inspired by C-3PO, paying tribute to one of our greatest helpers!

🌱Feature 6: Open Source and On-premise Deployment.

As an AI device, it is fundamental to respect privacy. And we embrace and implement two primary strategies in this nifty device.

SenseCAP Watcher is open source, giving you full access to thoroughly understand how it works.

It supports on-premise deployment. The backbone of SenseCAP Watcher is SenseCraft software suite, which is used to configure Watcher, interpret your commands, and access LLMs. Hence, everything is stored and running privately, ensuring that your models and data are not streamed to any public LLMs or public clouds. SenseCraft can run on Windows/ MacOS / Linux. Since SenseCraft contains LLMs, certain performance criteria are required for the computer, as follows.

You can deploy SenseCraft on your spare computers. However, if you aim for applications requiring commercial-grade reliability and low-power consumption, the combination of SenseCAP Watchter + NVIDIA® Jetson AGX Orin™ is perfect for you!

Compared to consumer-grade graphics cards (e.g. RTX 4090) for AI tasks, NVIDIA® Jetson AGX Orin™ stands out with key advantages:

Industrial-grade reliability: Designed for industrial and commercial applications, Jetson AGX series boasts a longer MTBF (Mean Time Between Failures). Engineered for 24/7 operation, it offers superior reliability for round-the-clock applications compared to consumer graphics cards.

Compact and low power: With embedded and edge computing applications in mind, Jetson AGX series are designed in a smaller form factor and consume 3+ times less power, compared to consumer graphics cards. Suitable for constrained spaces, Jetson AGX series generates less heat and helps reduce overall operating costs. This is crucial for embedded systems.

Specification

Hardware Overview

Support Various Mounting Methods

It can be placed on a desktop or mounted on walls as a smart expansion. Or it can also be transformed into the head of a robot.

Part List

Watcher x1

Universal wheel and base plate with adhesive x1

1/4" Female adapter set x1

USB Type-C cable x1

3*10mm screw x2