Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A TinyML Platform for On-Device Continual Learning with Quantized Latent
  Replays   In the last few years, research and development on Deep Learning models and
techniques for ultra-low-power devices in a word, TinyML has mainly focused on
a train-then-deploy assumption, with static models that cannot be adapted to
newly collected data without cloud-based data collection and fine-tuning.
Latent Replay-based Continual Learning (CL) techniques[1] enable online,
serverless adaptation in principle, but so farthey have still been too
computation and memory-hungry for ultra-low-power TinyML devices, which are
typically based on microcontrollers. In this work, we introduce a HW/SW
platform for end-to-end CL based on a 10-core FP32-enabled parallel
ultra-low-power (PULP) processor. We rethink the baseline Latent Replay CL
algorithm, leveraging quantization of the frozen stage of the model and Latent
Replays (LRs) to reduce their memory cost with minimal impact on accuracy. In
particular, 8-bit compression of the LR memory proves to be almost lossless
(-0.26% with 3000LR) compared to the full-precision baseline implementation,
but requires 4x less memory, while 7-bit can also be used with an additional
minimal accuracy degradation (up to 5%). We also introduce optimized primitives
for forward and backward propagation on the PULP processor. Our results show
that by combining these techniques, continual learning can be achieved in
practice using less than 64MB of memory an amount compatible with embedding in
TinyML devices. On an advanced 22nm prototype of our platform, called VEGA, the
proposed solution performs onaverage 65x faster than a low-power STM32 L4
microcontroller, being 37x more energy efficient enough for a lifetime of 535h
when learning a new mini-batch of data once every minute.

28
The categories of this paper are: alg-geom
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
15
The categories of this paper are: nucl-ex
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
25
The categories of this paper are: patt-sol
9
The categories of this paper are: nlin
19
The categories of this paper are: eess