ChatGPT Meets de Bono: A Powerful Combo

By -

I'm struggling to make a decision at the moment, so I've enlisted the help of ChatGPT.

I am experimenting a lot with some of the new AI tools, and it's a bit like playing whack-a-mole at the moment; as soon as I get to grips with one bit of software, another appears and demands my attention.

A lot of what I'm doing is based on OpenAI's ChatGPT. I'm concerned that I'll spend too much on paid services, so I am actively looking at Open Source alternatives that I could run locally.

Alas, many Large Language Models (LLMs) are too resource-hungry to run on my workstation, and I've been thinking of trying out a Jetson Xavier which I'm not using at the moment.

Worth the time?

I know I'll need to spend a few days getting to the point where I know whether I can use it for the projects I have in mind. Should I invest the time?

I decide to take a Judo approach and use ChatGPT to help me make the decision.

I used a prompt that's worked well for me before now. It based on de Bono's Six Thinking Hats.

You've probably come across the Six Thinking Hats technique before, but if not you can read about them on Wikipedia.

The Prompt and Response

Here's my question, along with ChatGPT's response. I've made minor tweaks to the format but the text is unchanged.

I'm thinking of running an LLM as an alternative to ChatGPT on my 16 GB Jetson Xavier developer kit.
Use Edward de Bono's Six Thinking Hats to help me evaluate that idea.

ChatGPT

Edward de Bono's Six Thinking Hats is a powerful decision-making tool that encourages looking at a problem or idea from
multiple perspectives. In this case, we'll use it to evaluate running an LLM (Large Language Model) as an alternative to
ChatGPT on a 16 GB Jetson Xavier developer kit.

White Hat (Facts and Information):

  1. The Jetson Xavier developer kit has 16 GB of RAM and a powerful GPU, making it suitable for running AI models.
  2. LLMs typically require significant computational power and memory.
  3. ChatGPT is based on GPT-4, which is also an LLM.

Red Hat (Emotions and Intuition):

  1. You might feel excited about running an LLM on your Jetson Xavier kit, as it could be a challenge and an opportunity to learn.
  2. Concerns may arise about whether the hardware is capable of handling such a large model efficiently.

Black Hat (Critical Judgement):

  1. Running an LLM on a Jetson Xavier developer kit might be limited by the 16 GB of RAM, depending on the size of the model.
  2. Performance and latency might be issues due to the large size of the LLM, affecting real-time applications.
  3. Power consumption and heat generation could be concerns when running a large model continuously.

Yellow Hat (Optimism and Benefits):

  1. Implementing an LLM on the Jetson Xavier kit could lead to a deeper understanding of AI models and their deployment on edge devices.
  2. It could potentially offer better performance compared to smaller models, resulting in more accurate and contextually aware responses.
  3. Developing and optimising an LLM for the Jetson Xavier kit could contribute to the growing AI community.

Green Hat (Creativity and Alternatives):

  1. Consider using a smaller, more efficient model that is optimised for edge devices, while still providing a satisfactory level of performance.
  2. Explore the possibility of using model distillation or pruning techniques to create a smaller model suitable for the Jetson Xavier kit.
  3. Investigate other hardware solutions or cloud-based platforms that may better accommodate the computational requirements of an LLM.

Blue Hat (Process and Summary):

In summary, running an LLM as an alternative to ChatGPT on a 16 GB Jetson Xavier developer kit has its pros and cons.
While it may offer better performance and accuracy, it might also present challenges related to hardware limitations,
power consumption, and heat generation. Consider exploring alternative models or hardware solutions, or optimizing the
LLM for edge devices. Ultimately, the decision will depend on the specific use case and the desired balance between
performance and efficiency.

Not bad for an AI!

I'm impressed by the response, as I have been with other uses of the prompt. I've also used two other de Bono frameworks: Six Value Medals, and Six Action Shoes. You can ask ChatGPT about them.

Pro tip: Make sure you are using ChatGPT 4, as version 3.5 has confused Action Shoes with the Thinking Hats!

The books are less well known but they can form the basis of useful prompts.

You'll also see from the Wikipedia article about Six Thinking Hats that there are recommended sequences of Hat use for tackling particular types of problem. These could form the basis of further useful prompts for ChatGPT.

I'll share more useful prompts as I discover them. You can keep track of them by following me on Twitter at @rareblog.


Comments

Post a Comment

Popular posts from this blog

Controlling a Raspberry Pi Pico remotely using PySerial

By -
Image
Update : I'm using thie code below in another project, and found that I had not correctly fixed the reported bug. The new version passes automated tests, and I am pretty sure it works OK. I have changed the name of the class to Talker  since it can both send and receive information. Apologies to all concerned for the bug! Introduction You can use a Raspberry Pi Pico as a powerful peripheral to a host - a Raspberry Pi, a Jetson Nano, a laptop or workstation. In this article you'll see how to interact with a Pico running MicroPython or CircuitPython by writing some Python code that runs on the host. The software is easy to use. It enables you to send a Python statement to the Pico and read the results. The statement can be any valid MicroPython code. Setting up the host and the Pico For this article I've used a Raspberry Pi as the host, but any computer running Windows, Linux or Mac OS will do so long as it has Python 3.5 or later installed. In particular, you can use this t
Read more

Five steps to connect Jetson Nano and Arduino

By -
Image
Yesterday's post showed how to link a micro:bit to the Jetson Nano. One of the members of the (unofficial) NVIDIA Jetson Nano group on Facebook asked about connecting an Arduino to the Jetson. Here's a simple recipe for getting data from the Arduino to the Jetson Nano. It should work on all the Jetson models, not just the Nano, but I only have Nanos to hand. On request, I've added a recipe at the end of this post which sends data from the Jetson Nano to the Arduino; it turns the default LED on the Arduino on or off. The recipe for sending data from the Arduino to the Jetson has just 5 stages: Program the Arduino. (I used the ASCIITable example). Connect the Arduino to the Jetson using a USB connector Install pyserial on the Jetson Download a three-line Python script Run the script.   Programming the Arduino I used an Arduino Uno, and checked it on a verteran Duemilanove (above), but any Arduino should work. You'll need to do this step usi
Read more

Raspberry Pi Pico project 2 - MCP3008

By -
Image
This post show you how to drive the MCP3008 8-channel ADC using a Raspberry Pi Pico. I'll start with a personally embarrassing and annoyingly relevant story. I'll also tell you about a minor 'gotcha' when using SPI on the Pico, and how you can avoid it. Finally, I've include the code and fritzing diagram I used to test the interface. First, the story. Back in 2012, when the Raspberry Pi was fresh and new, I was running a startup called Quick2Wire.  We made add-on boards for the Pi. Just before Christmas we sent out our first batch of boards to a small army of beta-testers. The beta boards didn't work. Somehow a single trace on the pcb had got deleted and one of the GPIO pins was isolated. The boards were still usable and it wasn't too hard to solder in a jumper wire to replace the missing trace, but it was very embarrassing. It wasn't just that we'd shipped boards with a defect. The really annoying thing was that I'd set up an  automated loop-bac
Read more