Responsible Use of ChatGPT and Large Language Models
This content draws on material developed for Module 6 of Arizona State University’s online undergraduate course on prompt engineering using ChatGPT. This module explores the broader societal implications of Large Language Models and their associated interfaces like ChatGPT
The following information and exercises are designed to help you:
- Describe key potential benefits and risks/ethical concerns associated with large language models (LLMs) and AI chatbots.
- Explain the concepts of responsible innovation and how it applies to LLMs and AI chatbots like ChatGPT.
- Apply ethical and responsible practices to the use of LLMs and AI chatbots, based on a set of personal Principles for Responsible Prompt Engineering.
The exercises here work best if using the paid ChatGPT Plus service from Open AI and GPT-4.
Introduction
The following video is the introduction to the final module of ASU’s introduction to prompt engineering using ChatGPT — hence the references to previous modules. It does, however, set up this training module effectively, as well as underlining the importance of learning how to use ChatGPT responsibly.
Overview
These exercises explore the broader societal implications of large language models (LLMs) and foundation models more broadly, and their associated interfaces like ChatGPT.
As you learn to work with these technologies, it’s crucial to consider not only their technical capabilities but also their potential impacts on society, both positive and negative. Through these exercises, you will explore key topics related to the ethical, social, and economic aspects of LLMs and ChatGPT (and by extension, other AI chatbots), while developing an understanding of concepts such as societally responsible innovation, responsible AI, principled innovation, ethical AI and innovation, and principles of ethical and responsible use.
The exercises start by exploring the benefits and risks associated with LLMs, such as enhanced communication and productivity, the potential spread of misinformation, and societal disruption. This provides an important perspective on the advantages and drawbacks of using these models in various contexts.
Next, they examines the challenges surrounding LLMs, such as the potential impacts on employment, the ethics of LLM development and use, and responsible and principled innovation. By considering these wide-ranging consequences, you will be better prepared to make responsible decisions and contribute positively to the evolving AI landscape and how ChatGPT is used across multiple domains.
They go on to explore responsible innovation in the context of ChatGPT, and some of the ethical dilemmas that surround its use.
By the end of these execrises, you should have a foundational understanding of the broader societal implications of large language models and AI chatbots and their role in shaping our world. You will be equipped with knowledge that will help you engage in thoughtful discussions about AI ethics and the responsible use of LLMs, fostering a more inclusive, transparent, and accountable approach to AI development. And you will be in a position to make more informed decisions when working with language models, and to contribute constructively to the ongoing conversation surrounding AI’s impact on society.
The exercises here assue you have access to ChatGPT Plus from Open AI. However, they are adaptable to other AI chatbot platforms.
Broader societal implications of LLMs and ChatGPT
As you explore the world of large language models and interfaces like ChatGPT, it’s crucial to consider their impact on society, both positive and negative. This understanding will not only help you become a responsible and principled prompt engineer, but will help you be part of ensuring that emerging AI capabilities are used for the betterment of all.
Key topics here include:
- Benefits of LLMs: Large language models (and interfaces like ChatGPT) can bring numerous advantages, including:
- Boosting productivity and efficiency across various professional domains.
- Democratizing access to information and knowledge.
- Supporting language translation and fostering cross-cultural understanding.
- Enabling creative applications in writing, art, and design.
- Accelerating the discovery of new knowledge, and novel solutions to complex problems.
- Creating highly personalized and tailored environments and experiences that accelerate learning.
- Substantially extending the ability of individuals and organizations to innovate, invent, design, learn, manufacture, and otherwise do what humans do.
- (There are many other benefits of LLMs – these are just some).
- Risks and challenges: These include:
- Misinformation and manipulation: LLMs can generate plausible yet false information, which could be exploited for spreading misinformation or manipulating opinions.
- Bias and discrimination: LLMs may unintentionally learn and perpetuate harmful biases present in their training data, leading to discriminatory or offensive outputs. As someone who is involved in prompt engineering, you should strive to recognize and mitigate such biases in your work.
- Privacy concerns: LLMs can inadvertently disclose sensitive or private information. Be mindful of privacy implications when designing prompts and applications.
- Job displacement: LLMs have the ability to disrupt jobs across multiple sectors and, through this, impact economic stability and growth.
- Loss of autonomy and dignity: Used irresponsibly, LLMs have the potential to undermine the ability of individuals to have control over their lives, and even to undermine what gives individuals a sense of self and purpose.
- (These are just some of the risks and challenges).
- Ethical considerations: These include:
- Fairness and equity: Ensuring that work with LLMs promotes fairness and equity by addressing potential biases and avoiding the exacerbation of existing inequalities.
- Transparency and accountability: Fostering a culture of responsibility and openness by disclosing the development, use, and limitations of LLMs in your projects.
- Loss of agency: Robbing people of the ability to be in control of their situation and their lives.
- Environmental impact: Being conscious of the energy consumption and carbon footprint associated with training and deploying large-scale AI models.
- (These are just some of the ethical considerations).
- The roles of responsible prompt engineering: These include:
- Crafting clear, precise, and unbiased prompts, to help direct LLMs towards generating accurate, relevant, and safe outputs.
- Focusing on creating prompt templates that ensure that LLMs are adaptable and perform well across diverse contexts, reducing the likelihood of unintended consequences.
- Evaluating the performance of LLMs critically, considering metrics that reflect ethical and societal aspects in addition to technical performance.
- The impact of LLMs on learning and education: These include:
- Understanding how LLMs may undermine learning by providing inaccurate, misleading, or otherwise false information, and learning how to address these limitations.
- Being aware of how LLMs might tempt students to take shortcuts in assignments that are classed as plagiarism or other forms of cheating.
- Understanding how LLMs can transform education and learning if used in innovative and responsible ways (this course is one example).
- Learning to develop prompts and prompt sequences that leverage the ability of LLMs to provide personalized and tailored learning environments.
- Governance and regulation: These include:
- Staying informed about ethical guidelines and best practices for LLM development and deployment.
- Engaging in dialogue with peers, academics, and policymakers to contribute to a regulatory framework that balances innovation with societal well-being.
- Advocating for public engagement and diverse perspectives to ensure that LLM development is guided by a broad range of values.
- Contributing to the effective governance and regulation of LLMs, including their development and use.
The following exercises will help develop a deeper understanding of a number of these topics
Exercise: Exploring the potential benefits of LLMs and ChatGPT
This exercise is designed to help you develop a broader understanding of the potential benefits of AI chatbots like ChatGPT and the underlying large language models.
It is also designed to demonstrate the use of ChatGPT in synthesizing rough notes.
You will gain the most from it if you are using ChatGPT Plus with GPT4
1. Spend some time exploring the potential benefits of LLMs, ChatGPT, and other AI chatbots. Use ChatGPT, Google, and any other sources at your disposal. Take notes.
2. Open a new ChatGPT session, making sure you are in GPT-4 mode.
3. Ask ChatGPT to synthesize your notes into a coherent statement on the potential benefits of LLMs and ChatGPT. This should be between 300 – 500 words long. (Note that this is an exercise in asking ChatGPT to make sense of unstructured notes – you do no need to refine and format your notes first!)
4. Check the accuracy of the summary, and if necessary ask ChatGPT to make corrections or refinements.
5. Keep a copy of the summary for future reference.
At the end of this exercise you should have a clearer understanding of the potential benefits and applications of LLMs and ChatGPT across different use-cases
Exercise: Exploring the potential risks and ethical challenges presented by LLMs and ChatGPT
This exercise is designed to help you develop a broader understanding of the potential risks, downsides, and ethical challenges associated with AI chatbots like ChatGPT and the underlying large language models.
1. Spend some time exploring the potential risks and ethical concerns associated with LLMs, ChatGPT, and other AI chatbots. Use ChatGPT, Google, and any other sources at your disposal. Take notes.
2. Open a ChatGPT session, making sure you are in GPT-4 mode.
3. Ask ChatGPT to synthesize your notes into a coherent statement on the potential risks and ethical concerns of LLMs and ChatGPT. This should be between 300 – 500 words long. (Note that this is an exercise in asking ChatGPT to make sense of unstructured notes – you do no need to refine and format your notes first!)
4. Check the accuracy of the summary, and if necessary ask ChatGPT to make corrections or refinements.
5. Keep a copy of the summary for future reference.
At the end of this exercise you should have a clearer understanding of the potential risks and ethical challenges associated with LLMs and ChatGPT across different use-cases
Exercise: Responsible Innovation and ChatGPT
This exercise uses a conversation with ChatGPT to help develop your understanding of responsible innovation in the context of responsible AI and ChatGPT. It is also an example of how to use prompt engineering to develop a responsive and tailored learning environment.
1. In a new session, provide ChatGPT (using GPT-4) with the following prompt:
Hi ChatGPT. My name is [include full name] and I would like you to act as my personal tutor and teach me about responsible innovation in the context of using ChatGPT. I would like you to cover the field broadly. Please start by asking me a question that helps you gauge my level of understanding. Based on my response, ask me a follow-up question that is designed to increase my understanding. Continue to do this until I show a broad understanding of responsible innovation in the context of using ChatGPT.
2. Repeat this exercise as many times as you like to further develop your understanding of responsible innovation within the context of ChatGPT
3. Consider tweaking the prompt to focus on specific areas of interest.
4. Remember to approach responses from ChatGPT with a critical mind, and validate using other sources where necessary — remember thar ChatGPT can make up information, and is not always accurate.
On completing this exercise you should have a deeper uderstanding of the concepts of responsible innovation ad responsivle AI, and how they apply to ChatGPT.
Exercise: Ethical dilemma
This exercise is designed to use ChatGPT to explore the nature and resolution of ethical dilemmas that may arise when using the platform. As you run the exercise, remember that ChatGPT is not a reliable source of information, and that you need to engage critical thinking while working with the chatbot. At the same time, the exercise demonstrates how, with the right approach, ChatGPT can help explore new ideas in useful ways.
This is an exercise where you will need to think about how best to craft the prompt you use with ChatGPT, how you develop the conversation that follows on from this, how you will assess the validity and usefulness of responses, and how you in turn will respond to this.
1. Open a new session of ChatGPT using GPT-4.
2. Ask ChatGPT to provide you with examples of three complex ethical dilemmas that involve the use of ChatGPT.
3. Select one of them and have a conversation with ChatGPT about the nature of the dilemma and how it might be addressed. Your conversation should include at least 5 exchanges with ChatGPT – ideally more. You should critically assess ChatGPT’s responses and provide feedback, guidance, and your perspective as appropriate.
4. Feel free to run this exercise a number of times.
By the end of this exercise you should have a better understanding of some of the ethcal dilemmas presented by ChatGPT in different contexts, and how they might be approached.
Exercise: Principles of Responsible Prompt Engineering
In this exercise you will work with ChatGPT to develop your own personal Principles of Responsible Prompt Engineering for using ChatGPT.
Drawing on your own ideas, context, and online sources and resources, work with ChatGPT to develop a personalized Principles of Personal Prompt Engineering. Remember to think about the prompts you use, the conversation you have, and how you can guide ChatGPT to develop a set of principles that is useful to you.
Your final personal Principles of Personal Prompt Engineering should have between 8 – 15 principles. Each should be clearly identified and have a brief (1 – 2 sentence) description.
By the end of this exercise you will have a set of personal principles that will stand you in good stead in using ChatGPT and other AI chatbots, along with their associated large language models.
Additional resources
The exercises here only scratch the surface of the responible AI and the socially responsible and ethical use of ChatGPT. If you are interested in discovering more, the following resources provide a useful starting point:
- Responsible Artificial Intelligence Institute
- Responsible AI Resources (Microsoft)
- Responsible AI (Google)
- National Institute of Standards and Technology (NIST) Trustworthy & Responsible AI Resource Center
- Responsible AI—Two Frameworks for Ethical Design Practice (IEEE)
- Ten AI Risks You Can’t Ignore (YouTube)