You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
As President Biden said, “To realize the promise of AI and avoid the risks, we need to govern this technology.” Last October, President Biden signed the landmark [Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence](https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/). This Executive Order lays out an ambitious agenda for the United States to meet this moment on AI. It directs federal agencies to establish new standards for AI safety and security, protect Americans’ privacy, and advance equity and civil rights—while also committing to harness AI for the public good.
22
+
As President Biden said, “To realize the promise of AI and avoid the risks, we need to govern this technology.” Last October, President Biden signed the landmark [Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/). This Executive Order lays out an ambitious agenda for the United States to meet this moment on AI. It directs federal agencies to establish new standards for AI safety and security, protect Americans’ privacy, and advance equity and civil rights—while also committing to harness AI for the public good.
23
23
24
24
## We need your help to accomplish these ambitious and essential goals.
25
25
@@ -48,5 +48,3 @@ To accomplish this, the Federal Government must understand AI models’ assumpti
48
48
Our ability to meet this moment depends on you. If you want to work on important and challenging problems, join us. Here, your work can truly make a difference for the public and help forge a future where AI is a force for good that improves the lives of everyone.
49
49
50
50
There are a wide variety of roles from temporary and long term, early career and highly specialized, technical and non-technical available all over the country.
51
-
52
-
Learn more about how to join us at [ai.gov/apply](http://ai.gov/apply).
[*As pubished on whitehouse.gov*](https://www.whitehouse.gov/omb/briefing-room/2024/08/13/10-years-of-the-u-s-digital-service-transforming-government-for-the-digital-age/){:target="blank"}
24
+
[*As pubished on whitehouse.gov*](https://bidenwhitehouse.archives.gov/omb/briefing-room/2024/08/13/10-years-of-the-u-s-digital-service-transforming-government-for-the-digital-age/){:target="blank"}
25
25
26
26
The American public deserves a government that delivers services effectively and builds trust. In 2014, the United States Digital Service (USDS) was born. Initially formed as a crisis response team to tackle service delivery challenges, USDS has since evolved into a trusted partner for over 30 federal agencies – working directly with them to deliver superior services to the public and to build digital capabilities for the future.
## Highlighting case studies across the government
24
24
25
-
In 2021, the Biden-Harris Administration issued an [Executive Order](https://www.whitehouse.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="blank"} to improve customer experience and make service delivery simple, seamless, and secure for Americans. Since then, government agencies have been hard at work making their services, tools, and content more effective in addressing the needs of the people they serve.
25
+
In 2021, the Biden-Harris Administration issued an [Executive Order](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="blank"} to improve customer experience and make service delivery simple, seamless, and secure for Americans. Since then, government agencies have been hard at work making their services, tools, and content more effective in addressing the needs of the people they serve.
26
26
27
27
User research is at the heart of transforming customer experience. The best way to ensure services are effective, efficient, easy to use, fair, and safe is to include the people they are intended for when building it.
28
28
@@ -52,7 +52,7 @@ Specifically, there are activities common in user research that **do not** requi
52
52
53
53
- Asking people non-standardized questions as part of a one-on-one research session (i.e., asking people questions orally, in an unstructured way, about navigating government benefits or signing up for an appointment). “Non-standardized,” in this context, means the questions asked vary from person to person, and are not drawn from a list of identical questions posed in every research session.
54
54
55
-
Unlike methods that constitute information collection and require PRA clearance (for example, surveys or large focus groups with a set of the same questions or tasks), these types of research conversations (direct observations or one-on-one sessions with non-standardized questions) do not require PRA approval, regardless of the number of users ultimately involved in the research. On November 19, 2024 this was further clarified in a [briefing room](https://www.whitehouse.gov/omb/briefing-room/2024/11/21/ensuring-effective-and-timely-usability-research/){:target="blank"} blog by the White House and the Office of Information and Regulatory Affairs (OIRA) and in this [Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
55
+
Unlike methods that constitute information collection and require PRA clearance (for example, surveys or large focus groups with a set of the same questions or tasks), these types of research conversations (direct observations or one-on-one sessions with non-standardized questions) do not require PRA approval, regardless of the number of users ultimately involved in the research. On November 19, 2024 this was further clarified in a [briefing room](https://bidenwhitehouse.archives.gov/omb/briefing-room/2024/11/21/ensuring-effective-and-timely-usability-research/){:target="blank"} blog by the White House and the Office of Information and Regulatory Affairs (OIRA) and in this [Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
56
56
57
57
Direct observations and one-on-one feedback sessions can be more valuable than [focus groups](https://www.nngroup.com/articles/focus-groups-definition/){:target="blank"} or [surveys](https://www.nngroup.com/articles/should-you-run-a-survey/){:target="blank"}, since they may provide a deeper understanding of people’s behavior rather than feelings and opinions and showcase what's working well, what isn't, and why. You can learn more about talking to people with [tips](https://www.dhs.gov/cx/how-do-I-talk-to-customers){:target="blank"} from the Department of Homeland Security.
58
58
@@ -126,7 +126,7 @@ During the second round of research, the main focus was observing individuals as
126
126
127
127
**Why did the PRA not cover this research?**
128
128
129
-
In this project, the DOL directly observed the experiences of program applicants and participants and asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo.](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
129
+
In this project, the DOL directly observed the experiences of program applicants and participants and asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo.](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
130
130
131
131
### Case study 2: Conducting user research for a new application launch
132
132
@@ -149,7 +149,7 @@ The team observed Veterans using the existing application to identify pain point
149
149
150
150
**Why did the PRA not cover this research?**
151
151
152
-
In this project, the VA directly observed the experiences of program applicants and participants and engaged in unstructured one-on-one interactions. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing an online application. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
152
+
In this project, the VA directly observed the experiences of program applicants and participants and engaged in unstructured one-on-one interactions. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing an online application. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
153
153
154
154
### Case study 3: Conducting user research to inform policy and strategy
155
155
@@ -222,7 +222,7 @@ The team performed user research throughout the year by working with non-profits
222
222
223
223
**Why the PRA did not cover this research?**
224
224
225
-
In this project, the groups directly observed the experiences of program applicants and participants. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing text messages. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
225
+
In this project, the groups directly observed the experiences of program applicants and participants. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing text messages. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
226
226
227
227
228
228
### Case study 6: Conducting user research with internal users of a system
@@ -245,7 +245,7 @@ ORR contacted case workers nationwide and observed them filling out both version
245
245
246
246
**Why did the PRA not cover this research?**
247
247
248
-
In this project, the ORR directly observed case workers (not federal employees) using a form via one-on-one interviews to understand any usability concerns. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a form. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
248
+
In this project, the ORR directly observed case workers (not federal employees) using a form via one-on-one interviews to understand any usability concerns. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a form. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
249
249
250
250
### Case study 7: Conducting user research with students and families
251
251
@@ -269,7 +269,7 @@ Based on this research, the team developed a College Scorecard prototype and the
269
269
270
270
**Why did the PRA not cover this research**?
271
271
272
-
In this project, the Department of Education directly observed the program applicants and participants engaging with the College Scorecard. The Department of Education also asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
272
+
In this project, the Department of Education directly observed the program applicants and participants engaging with the College Scorecard. The Department of Education also asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
Copy file name to clipboardExpand all lines: _news-and-blog/2025-01-07-a-decade-of-partnership-between-usds-and-ssa.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -36,7 +36,7 @@ Before the redesign of SSA.gov, site visitors relied on a single, static page wi
36
36
37
37
### Addressing Retirement Life Experience
38
38
39
-
When the [Customer Experience (CX) Executive Order](https://www.whitehouse.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="_blank"} was released in 2021, the USDS team worked with SSA to improve the retirement life experience. Through the discovery process, the team uncovered a lack of consolidated and connected CX data. It was difficult to fully understand the holistic customer experience and journey due to the disparate data sources.
39
+
When the [Customer Experience (CX) Executive Order](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="_blank"} was released in 2021, the USDS team worked with SSA to improve the retirement life experience. Through the discovery process, the team uncovered a lack of consolidated and connected CX data. It was difficult to fully understand the holistic customer experience and journey due to the disparate data sources.
40
40
41
41
To assist in solutioning the data challenge, USDS engaged with SSA two years later on a comprehensive CX data strategy, focusing on more than just customer satisfaction, but also system performance and employee burden. Through the various project phases -- discovery, identifying and analyzing data, and strategy development -- USDS further surfaced that the challenges and opportunities with retirement and Medicare processes were not unique to those specific programs. Instead, solving these common CX and employee experience pain points was foundational to improving outcomes with SSA’s highest priorities related to disability programs and various service channels (online, phone, in-person, etc.).
Copy file name to clipboardExpand all lines: _projects/0600_ditap.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -40,7 +40,7 @@ Current federal procurement practices rarely provide the flexibility required to
40
40
41
41
## The Solution
42
42
43
-
In 2016, USDS and OFPP created the Digital IT Acquisition Professional Program (DITAP), a Federal Acquisition Certification in Contracting (FAC‑C) certification program that trains contracting professionals to execute digital service procurements by acting as business advisors to agencies seeking to buy better digital services. DITAP leverages flexibilities in the Federal Acquisition Regulation to better acquire today’s technology and works seamlessly with digital service teams or acquisition innovation labs. Graduates of the DITAP program can also lead agency training workshops and provide consultations, expanding digital service procurement expertise across the government. In a [May 2018 memo](https://whitehouse.gov/wp-content/uploads/2018/05/fac_c_digital_services_05_12_18.pdf), OMB determined that beginning in FY 2022, contracting professionals assigned to digital services acquisitions above $7 million will be required to have FAC‑C‑DS certification.
43
+
In 2016, USDS and OFPP created the Digital IT Acquisition Professional Program (DITAP), a Federal Acquisition Certification in Contracting (FAC‑C) certification program that trains contracting professionals to execute digital service procurements by acting as business advisors to agencies seeking to buy better digital services. DITAP leverages flexibilities in the Federal Acquisition Regulation to better acquire today’s technology and works seamlessly with digital service teams or acquisition innovation labs. Graduates of the DITAP program can also lead agency training workshops and provide consultations, expanding digital service procurement expertise across the government. In a [May 2018 memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2018/05/fac_c_digital_services_05_12_18.pdf), OMB determined that beginning in FY 2022, contracting professionals assigned to digital services acquisitions above $7 million will be required to have FAC‑C‑DS certification.
0 commit comments