Big data on a small computer!

By -

Neural Networks on the Raspberry Pi

I've been having some fun experimenting with ANNs (Artificial Neural Networks) on the Raspberry Pi.

I've been interested in ANN research for a very long while: I wrote my first simulator back in 1974.

I developed that first version in ALGOL60. I've recently re-written and extended it in Dyalog APL, and now it runs on the Raspberry Pi.

Why APL?

I've found APL a great choice for ANN research and education, for several reasons:
  • It's easy to learn, and fun!
  • It's concise and easy to test.
  • It handles arrays naturally.
  • It has a rich set of primitives for data manipulation and calculation.
  • It supports a pure functional programming style.
  • Dyalog APL has great support for parallel computing.
  • The Raspberry Pi version is free for non-commercial use.

Inexpensive ANN computing

I'm using a Raspberry Pi B model 3, but it runs acceptably fast on earlier versions of the Pi. I haven't yet tried it on the Pi Zero, but it should be fine.

The ANN code now uses the Raspberry Pi 3's multiple cores without any changes to the software.

A small additional effort would let me distribute the simulation over several networked Pi's. If I need more performance, £500/$750 would buy a stack of 16 Pi 3s with 64 cores and 16Gb of RAM - enough to do some serious work on very big datasets! Of course, I'd also need to re-license the software if I were using it commercially.

More on ANNs

I'm currently working on a presentation about neural networks and APL. As I complete each section I'll post notes and sample code on this blog.

You can read them here:
  1. Neural networks on the Raspberry Pi: The Neuron
  2. Neural networks on the Raspberry Pi: More Neurons

How can you experiment with APL?

If you want to get started, try the great tutorials on TryAPL.org. They will let you explore this powerful and expressive language.

If you want to run your own APL environment on a Raspberry Pi you can get it here.






Comments

Post a Comment

Popular posts from this blog

Controlling a Raspberry Pi Pico remotely using PySerial

By -
Image
Update : I'm using thie code below in another project, and found that I had not correctly fixed the reported bug. The new version passes automated tests, and I am pretty sure it works OK. I have changed the name of the class to Talker  since it can both send and receive information. Apologies to all concerned for the bug! Introduction You can use a Raspberry Pi Pico as a powerful peripheral to a host - a Raspberry Pi, a Jetson Nano, a laptop or workstation. In this article you'll see how to interact with a Pico running MicroPython or CircuitPython by writing some Python code that runs on the host. The software is easy to use. It enables you to send a Python statement to the Pico and read the results. The statement can be any valid MicroPython code. Setting up the host and the Pico For this article I've used a Raspberry Pi as the host, but any computer running Windows, Linux or Mac OS will do so long as it has Python 3.5 or later installed. In particular, you can use this t
Read more

Five steps to connect Jetson Nano and Arduino

By -
Image
Yesterday's post showed how to link a micro:bit to the Jetson Nano. One of the members of the (unofficial) NVIDIA Jetson Nano group on Facebook asked about connecting an Arduino to the Jetson. Here's a simple recipe for getting data from the Arduino to the Jetson Nano. It should work on all the Jetson models, not just the Nano, but I only have Nanos to hand. On request, I've added a recipe at the end of this post which sends data from the Jetson Nano to the Arduino; it turns the default LED on the Arduino on or off. The recipe for sending data from the Arduino to the Jetson has just 5 stages: Program the Arduino. (I used the ASCIITable example). Connect the Arduino to the Jetson using a USB connector Install pyserial on the Jetson Download a three-line Python script Run the script.   Programming the Arduino I used an Arduino Uno, and checked it on a verteran Duemilanove (above), but any Arduino should work. You'll need to do this step usi
Read more

Raspberry Pi Pico project 2 - MCP3008

By -
Image
This post show you how to drive the MCP3008 8-channel ADC using a Raspberry Pi Pico. I'll start with a personally embarrassing and annoyingly relevant story. I'll also tell you about a minor 'gotcha' when using SPI on the Pico, and how you can avoid it. Finally, I've include the code and fritzing diagram I used to test the interface. First, the story. Back in 2012, when the Raspberry Pi was fresh and new, I was running a startup called Quick2Wire.  We made add-on boards for the Pi. Just before Christmas we sent out our first batch of boards to a small army of beta-testers. The beta boards didn't work. Somehow a single trace on the pcb had got deleted and one of the GPIO pins was isolated. The boards were still usable and it wasn't too hard to solder in a jumper wire to replace the missing trace, but it was very embarrassing. It wasn't just that we'd shipped boards with a defect. The really annoying thing was that I'd set up an  automated loop-bac
Read more