{"id":25029,"date":"2024-09-10T11:16:00","date_gmt":"2024-09-10T15:16:00","guid":{"rendered":"https:\/\/design.ncsu.edu\/graphic-design\/?p=25029"},"modified":"2024-10-08T11:51:49","modified_gmt":"2024-10-08T15:51:49","slug":"sight-unseen-students-design-ux-for-intelligence-analysts-2","status":"publish","type":"post","link":"https:\/\/design.ncsu.edu\/graphic-design\/2024\/09\/10\/sight-unseen-students-design-ux-for-intelligence-analysts-2\/","title":{"rendered":"Sight Unseen, Students Design UX for Intelligence Analysts"},"content":{"rendered":"\n\n\n\n\n<blockquote class=\"wp-block-ncst-pullquote has-custombg-seven-text-color\"><div class=\"pullquote-container\"><p class=\"pullquote-content\">I was fascinated by the concept of working with students to visualize potential solutions to the many pain points we face as analysts.\u201d \u2013 Tim S., LAS intelligence analyst<\/p><\/div><\/blockquote>\n\n\n\n<h1 class=\"wp-block-heading\">A Fictitious Terrorist Attack<\/h1>\n\n\n\n<p>\u201cIn 2019 a bombing killed two people and injured others in the city of Macondo, a mountain town in Oceania. A commercially made drone fitted with an IED (improvised exploding device) targeted a coffee shop on North Duke Street in the morning hours of April 10, 2019.\u201d<\/p>\n\n\n\n<p>This fictitious scenario is one of many that our nation\u2019s intelligence analysts might face. This year the Laboratory for Analytic Sciences worked with Professor Helen Armstrong\u2019s students in the&nbsp;<a href=\"https:\/\/design.ncsu.edu\/graphic-design\/academics\/masters\/\" target=\"_blank\" rel=\"noreferrer noopener\">Master of Graphic &amp; Experience Design (MGXD) program at the NC State College of Design<\/a>. Their assignment? To consider how analysts at different stages of their careers might use particular workflows, or particular analyst challenges, to investigate this scenario and design an interface that could address those challenges.&nbsp;&nbsp;<\/p>\n\n\n\n<h1 class=\"wp-block-heading\">Developing Interface Concepts for Different Analyst Workflows<\/h1>\n\n\n\n<p>The intelligence analysts responsible for finding and making sense of the technical data that will be used to inform the country\u2019s decision-makers, via a final intelligence analysis report, are known as target digital network analysts (TDNAs).&nbsp;<strong>For this semester\u2019s work, the students were separated into four groups. Each group played the part of a TDNA facing different analyst challenges, with various skill levels and expertise, and with differing tasks to complete.<\/strong><\/p>\n\n\n\n<p>While the students were eager to start the assignment, LAS wanted to ensure they had the tools necessary to tackle this complicated task. Led by Professor Helen Armstrong, the graduate students were divided into four groups and given a&nbsp;<a href=\"https:\/\/ncsu-las.org\/2024\/03\/an-intel-source-for-researchers\/\">persona<\/a>&nbsp;along with a fictional scenario. Students also interviewed real-world intelligence analysts to understand how these pain points affect daily workflows. Taking this information, they set about their work via user experience (UX) design methods to research and develop innovative solutions that addressed user pain points and unique design criteria. LAS mentors met with students multiple times both virtually and in person to answer questions and to give feedback on prototypes created.<\/p>\n\n\n\n<h1 class=\"wp-block-heading\">The Final Product: Four Prototypes<\/h1>\n\n\n\n<p>The four student groups each developed a prototype they presented to LAS at the end of the semester.&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Hello, World!<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><strong><em>DataTrace for Susie, an entry-level analyst on her first day<\/em><\/strong><\/h3>\n\n\n\n<p><em>Designers: Alexis Boone, Rebecca Planchart, Kweku Baidoo, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved <\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"GD502_LAS_ ScenarioVideo_DataTrace_Group1_2024 mp4\" src=\"https:\/\/player.vimeo.com\/video\/975443120?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>This fictional scenario describes a rookie analyst\u2019s first query. Students designed a high-fidelity UX prototype they named DataTrace, based on \u201cSusie,\u201d an entry-level analyst persona supplied by LAS. Susie has been tasked with looking up an email address that has recently been in communication with a terrorist group from the fictional country Zendia. Susie\u2019s team believes it belongs to a new operative.&nbsp;<\/p>\n\n\n\n<p>She opens the DataTrace interface and types into the search field.&nbsp;<\/p>\n\n\n\n<p>\u201cI am a new network analyst and need help querying an email address that we suspect is being used by the Zendian terrorist organization in relation to a bombing in the Oceania city of Macondo.\u201d<\/p>\n\n\n\n<p>Because DataTrace was designed to address the anxieties of a new analyst, Susie finds the natural language approach to queries very intuitive.<\/p>\n\n\n\n<p>At the end of the day, Susie has run several queries and analyzed a range of data. She is ready to review her activity and submit an analysis summary to her mentor. She expands the data basket where she\u2019s been dragging and dropping relevant information for the AI to synthesize in the background. The data basket has two tabs.<\/p>\n\n\n\n<p>The first tab highlights her activity throughout the day. She can share that with her mentor and refer back to it the next day as a reminder of where she\u2019s left off. The system pulls out specific details such as the resources she\u2019s accessed, the queries she\u2019s run, and the results of her analysis.&nbsp;<\/p>\n\n\n\n<p>On the second tab, the system automatically summarizes those results using natural language processing. The system points out areas that were not covered by Susie\u2019s analysis such as detailed content analysis and an insufficient understanding of IP addresses at the bottom of the page. The AI toggles on filters to either suggest areas of improvement or expand the summary based on the information Susie dropped into the data basket. She has the option to edit or regenerate the summary, but she likes the way the system summarized her work and made it easy to share it with her mentor to review her work. She believes her analysis will help her contribute to her team\u2019s mission.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Mind The Gap<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><strong><em>RedFlag for Josh, a junior analyst who is struggling to understand when his data sources have gaps<\/em><\/strong><\/h3>\n\n\n\n<p><em>Designers: Aimsley McDaniel, Sophia Milligan, Leighann Vinesett, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"GD502_LAS_ScenarioVideo_2024_MindTheGap (1)\" src=\"https:\/\/player.vimeo.com\/video\/975431852?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>This scenario describes how an analyst with more intermediate experience determines what data they are missing. RedFlag is a high-fidelity UI\/UX prototype created by the second team of students. It\u2019s based on the fictional analyst persona \u201cJosh,\u201d a junior analyst with a little more experience than Susie.&nbsp;<\/p>\n\n\n\n<p>Josh begins his day by resuming the active investigation into the bombing in Macondo. In RedFlag\u2019s main panel, he reviews a notification he filed last Friday alerting him that the data from the IED drone\u2019s RFID chip is corrupted. Josh quickly examines the notification details and reopens the RFID database Scan Shield to refresh his memory of what he was querying for \u2013 information about the drone\u2019s flight path before the bombing.&nbsp;<\/p>\n\n\n\n<p>In the interface, Josh sees that 100 rows of data are corrupted. RedFlag\u2019s AI-generated \u201cNext Steps\u201d feature indicates that Josh needs to clean his data before beginning his analysis. He is familiar with the suggested data cleaning process and clicks to begin. RedFlag\u2019s AI recognizes the language of the unreadable data as hexadecimal code and suggests a way to translate the data. Josh accepts the translation and proceeds to the next step of the cleaning process, data deduplication. Josh sees the AI has flagged every duplicate in the dataset, not just those he believes are relevant to his analysis. He quickly edits the parameters to only select rows of data that are identical and RedFlag\u2019s AI regenerates the selection. Josh accepts the changes and advances to the last step \u2013 removing missing data. RedFlag\u2019s AI highlights three empty rows that can be removed to complete the data-cleaning process.<\/p>\n\n\n\n<p>Finally, Josh scans the clean data to validate that the process was successful. Feeling confident, he resolves a RedFlag notification and reruns his initial flight path query on the newly cleaned data. RedFlag has made it easy to see inconsistencies and gaps to address in the data and simplified his data-cleaning work.<\/p>\n\n\n\n<p>While he waits for this query to complete, Josh begins setting up a new query in a CCTV database commonly used in Oceania. He structures his query to search for CCTV footage from cameras within a five-mile radius of North Duke Street where the bombing occurred. As Josh writes the query, he receives a RedFlag notification alerting him of a spelling error. Josh expands the notification and sees that he has incorrectly spelled Macondo as \u201cMakondo.\u201d This has the potential to return results from outside Oceania and break compliance. Josh quickly corrects the spelling and runs the query.&nbsp;<\/p>\n\n\n\n<p>As his results appear, Josh sees there\u2019s a large chunk of video footage missing, potentially indicating that the cameras were not functional for multiple days. He clicks the gap area in the visualization and discovers that the software was unable to retrieve CCTV footage from April 6 through 11th. This means that any video footage of the drone\u2019s flight path on the day of the bombing is missing. After ensuring that this gap is not due to an internal collection error, Josh checks the \u201cNext Steps\u201d in RedFlag which provides him with two possible solutions that may help him understand why the footage is missing. Josh sees that he can either expand his search to include commercial CCTV footage or start a new query for maintenance reports. After noticing that the maintenance report search will be faster, he proceeds with this option.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>You Can\u2019t Do That!<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><strong><em>ComplAI for Michele, an experienced analyst who runs a non-compliant query<\/em><\/strong><\/h3>\n\n\n\n<p><em>Designers: Soumya Batra, Aashka Patel, Leah Tatu, Gabrielle Thorpe, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"GD502_LAS_ ScenarioVideo_ComplAI_Group3_2024 mp4\" src=\"https:\/\/player.vimeo.com\/video\/975432143?dnt=1&amp;app_id=122963\" width=\"500\" height=\"264\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>The third scenario describes what happens when an analyst queries something for which their intelligence agency does not have the authority to access; a non-compliant query. It is from the perspective of \u201cMichele,\u201d a seasoned, mid-career analyst. The students designed a widget that helps analysts like Michele maintain access compliance while searching for intelligence leads. Pronounced \u201ccomply,\u201d ComplAI features alerts about data protection laws and the ability to automatically schedule appointments with legal experts.<\/p>\n\n\n\n<p>Michele\u2019s task is to find leads on Zendia\u2019s military tactics, particularly the use of drones in armed conflict. Using the ComplAI interface, she searches a database of online transactions to look for links between SkyOne drone manufacturing and Zendia. Michele also types in a second request asking the AI to provide appropriate compliance recommendations. As she searches, she adds a justification note that she is analyzing purchase data for Zendian-manufactured drones to uncover security breaches and their link to a bombing using user interactions and time stamps.&nbsp;<\/p>\n\n\n\n<p>While she\u2019s analyzing the results of her search, ComplAI alerts her of an update to the European Union\u2019s GDPR data protection law. The system flags Michele\u2019s query as high risk for potential compliance violations. To learn more about this assessment, Michele uses the ComplAI chat. She inquires about regulatory guidelines related to purchase and transaction history. She asks a follow-up question asking for some examples of regulatory criteria in response. ComplAI suggests contacting a lawyer and displays an appointment booking module. She adds it to her calendar.&nbsp; It also points out the potentially non-compliant parts of her query and provides the source of the compliance breach. The AI suggests how to better frame her query and gives her an option to generate a risk-free compliant query, which she accepts and continues working.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Crossing the Streams<\/strong><\/h2>\n\n\n\n<h3 class=\"wp-block-heading\"><strong><em>Spine for Miguel, an expert analyst who struggles to combine information from many different intelligence sources<\/em><\/strong><\/h3>\n\n\n\n<p><em>Designers: Olha Novikova, Parinita Das, Vaishnavi Parni, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"GD502_LAS_ScenarioVideo_2024_CrossingTheStreams\" src=\"https:\/\/player.vimeo.com\/video\/975430742?dnt=1&amp;app_id=122963\" width=\"500\" height=\"281\" frameborder=\"0\" allow=\"autoplay; fullscreen; picture-in-picture; clipboard-write\"><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>Michele, Josh and Susie have all been working on different tasks related to intelligence gathering and analysis for the bombing in Macondo. Their team leader \u201cMiguel\u201d is an expert analyst, and LAS shared the following scenario with the design students describing how an expert analyst may approach synthesizing data from many places. The final group of design students created a prototype of a user interface for him called Spine.&nbsp;<\/p>\n\n\n\n<p>At the start of the workday, Miguel receives an email from his agency\u2019s headquarters that a bombing killed two people and injured others in the city of Macondo. He begins his investigation in the Spine software by setting the day\u2019s goals and objectives. He selects the case type (terrorist attack) from the drop-down menu and inputs the case details. Miguel enters the time, date, location, and description of the bombing scenario for his team. These inputs inform the AI about the context of the case.<\/p>\n\n\n\n<p>Miguel then adds case objectives and assigns them to junior analysts. He asks Josh to find suspicious activities through the networks in Macondo and Michele to analyze drone purchase data in Zendia. The AI recommends related datasets as useful starting points for the junior analysts. Miguel accepts some of these suggestions but he also adds a network dataset. He saves the goals, objectives and context and sends them to the junior analyst, Josh.&nbsp;<\/p>\n\n\n\n<p>Josh receives a notification from Miguel asking him to look for suspicious network activity in the bombing area. Josh considers the recommended dataset and then he begins with the cellular network dataset. Josh inputs a prompt in natural language that generates a query using appropriate syntax. Josh requests data for WiFi connections in the cafe\u2019s vicinity one day prior to the attack. He wants to identify potential suspects who utilize the network to connect to drone or other suspicious devices. Josh runs the query but he does not find any suspicious activity. Josh realizes that his query did not produce enough results because the time frame and the area were too narrow. So he broadens the parameters. He then discovers that a specific device has connected to multiple public WiFi networks within the specified time frame. This suspicious activity presents a significant lead. Excited, Josh makes sure to input the query, its justification, and findings, and then adds it to Spine.&nbsp;<\/p>\n\n\n\n<p>While Miguel is running his own queries, some of his teammates queries appear in the team window labeled as outlier queries. The outlier flag could indicate a syntax error, a compliance break or perhaps a unique successful query. To overview the AI-identified outlier queries, Miguel cross-checks Josh and Michele\u2019s queries.&nbsp;<\/p>\n\n\n\n<p>Miguel examines one of Josh\u2019s queries that is marked as an outlier. He discovers that Josh has formulated a unique approach to the query that yielded particularly promising results. He then reviews Michele\u2019s query and prompts and discovers that her query produced broad results that might lead to compliance issues. He later mentors her in person regarding the compliance dangers.&nbsp;<\/p>\n\n\n\n<p>Miguel finishes his daily task and starts crafting a team report. The AI generates documentation based on the input context, objectives, queries and findings. The results include executive summary, key observations and tradecraft analysis. Miguel can make edits to the AI-generated reports and cross verify them with the findings from his junior analysts to form a bigger picture of the investigation. Additionally the AI recommends refining future tradecraft and investigation processes providing Miguel with valuable results. Once Miguel is content with the report, he can seamlessly export it and share it with senior leadership at his intelligence agency.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/ncsu-las.org\/wp-content\/uploads\/2024\/09\/Armstrong-Design-Students-2024.png\" alt=\"A professor is seated with a dozen students gathered behind her, smiling.\" class=\"wp-image-3782\"\/><figcaption class=\"wp-element-caption\">Professor Armstrong, center, is the director of the Master of Graphic &amp; Experience Design (MGXD) program at the College of Design. Her students worked with LAS to learn how intelligence analysts at different stages of their careers might investigate a fictitious bombing scenario. As part of their final project, the students were tasked with designing an interface to facilitate an analyst\u2019s investigation into the scenario. The students include Kweku Baidoo, Soumya Batra, Alexis Boone, Parinita Das, Aimsley McDaniel, Sophia Milligan, Olha Novikova, Vaishnavi Parni, Aashka Patel, Rebecca Planchart, Leah Tatu, Gabrielle Thorpe, Leighann Vinesett.<\/figcaption><\/figure>\n\n\n\n<h1 class=\"wp-block-heading\"><strong>A Fresh Perspective<\/strong><\/h1>\n\n\n\n<p><strong>Ultimately, the students created four unique UX perspectives that can be used in future updates to real-world systems. Their final presentations show the true power of academia-government partnerships in safeguarding and protecting national security.<\/strong><\/p>\n\n\n\n<p>\u201cThis was a very enlightening experience working with the students and seeing fresh perspective in UX designs, as well as seeing their enthusiasm to work with government personnel to solve real-world problems,\u201d a member of LAS said. \u201cOften, UX is not really taken into account when designing tools that we use daily. The students took our feedback on board and this was evident during the evolution of their designs. The final products did not disappoint! I look forward to working with future students and who knows, the prototypes they envisage could turn into a real-world solution.\u201d<\/p>\n\n\n\n<h1 class=\"wp-block-heading\"><strong>About LAS<\/strong><\/h1>\n\n\n\n<p>The Laboratory for Analytic Sciences is a partnership between the intelligence community and North Carolina State University that develops innovative technology and tradecraft to help solve mission-relevant problems. Founded in 2013 by the National Security Agency and NC State, each year LAS brings together collaborators from three sectors \u2013 industry, academia, and government \u2013 to conduct research that has a direct impact on national security.<\/p>\n","protected":false,"raw":"<!-- wp:ncst\/dynamic-header {\"block\":\"ncst\/default-post-header\"} -->\n<!-- wp:ncst\/default-post-header {\"caption\":\"LAS is a collaboration between NC\u00a0State University and the National Security Agency. NC\u00a0State College of Design students worked with LAS to learn how intelligence analysts at different stages of their careers might investigate a fictitious bombing scenario. As part of their final project, the students were tasked with designing an interface to facilitate an analyst\u2019s investigation into the scenario.\"} \/-->\n<!-- \/wp:ncst\/dynamic-header -->\n\n<!-- wp:ncst\/pullquote {\"value\":\"\u201cI was fascinated by the concept of working with students to visualize potential solutions to the many pain points we face as analysts.\u201d \u2013 Tim S., LAS intelligence analyst\",\"textColor\":\"custombg_seven\"} -->\n<blockquote class=\"wp-block-ncst-pullquote has-custombg-seven-text-color\"><div class=\"pullquote-container\"><p class=\"pullquote-content\">I was fascinated by the concept of working with students to visualize potential solutions to the many pain points we face as analysts.\u201d \u2013 Tim S., LAS intelligence analyst<\/p><\/div><\/blockquote>\n<!-- \/wp:ncst\/pullquote -->\n\n<!-- wp:heading {\"level\":1} -->\n<h1>A Fictitious Terrorist Attack<\/h1>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p>\u201cIn 2019 a bombing killed two people and injured others in the city of Macondo, a mountain town in Oceania. A commercially made drone fitted with an IED (improvised exploding device) targeted a coffee shop on North Duke Street in the morning hours of April 10, 2019.\u201d<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>This fictitious scenario is one of many that our nation\u2019s intelligence analysts might face. This year the Laboratory for Analytic Sciences worked with Professor Helen Armstrong\u2019s students in the&nbsp;<a href=\"https:\/\/design.ncsu.edu\/graphic-design\/academics\/masters\/\" target=\"_blank\" rel=\"noreferrer noopener\">Master of Graphic &amp; Experience Design (MGXD) program at the NC State College of Design<\/a>. Their assignment? To consider how analysts at different stages of their careers might use particular workflows, or particular analyst challenges, to investigate this scenario and design an interface that could address those challenges.&nbsp;&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading {\"level\":1} -->\n<h1>Developing Interface Concepts for Different Analyst Workflows<\/h1>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p>The intelligence analysts responsible for finding and making sense of the technical data that will be used to inform the country\u2019s decision-makers, via a final intelligence analysis report, are known as target digital network analysts (TDNAs).&nbsp;<strong>For this semester\u2019s work, the students were separated into four groups. Each group played the part of a TDNA facing different analyst challenges, with various skill levels and expertise, and with differing tasks to complete.<\/strong><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>While the students were eager to start the assignment, LAS wanted to ensure they had the tools necessary to tackle this complicated task. Led by Professor Helen Armstrong, the graduate students were divided into four groups and given a&nbsp;<a href=\"https:\/\/ncsu-las.org\/2024\/03\/an-intel-source-for-researchers\/\">persona<\/a>&nbsp;along with a fictional scenario. Students also interviewed real-world intelligence analysts to understand how these pain points affect daily workflows. Taking this information, they set about their work via user experience (UX) design methods to research and develop innovative solutions that addressed user pain points and unique design criteria. LAS mentors met with students multiple times both virtually and in person to answer questions and to give feedback on prototypes created.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading {\"level\":1} -->\n<h1>The Final Product: Four Prototypes<\/h1>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p>The four student groups each developed a prototype they presented to LAS at the end of the semester.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading -->\n<h2><strong>Hello, World!<\/strong><\/h2>\n<!-- \/wp:heading -->\n\n<!-- wp:heading {\"level\":3} -->\n<h3><strong><em>DataTrace for Susie, an entry-level analyst on her first day<\/em><\/strong><\/h3>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p><em>Designers: Alexis Boone, Rebecca Planchart, Kweku Baidoo, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved <\/em><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:embed {\"url\":\"https:\/\/vimeo.com\/975443120\",\"type\":\"video\",\"providerNameSlug\":\"vimeo\",\"responsive\":true,\"className\":\"wp-embed-aspect-16-9 wp-has-aspect-ratio\"} -->\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/vimeo.com\/975443120\n<\/div><\/figure>\n<!-- \/wp:embed -->\n\n<!-- wp:paragraph -->\n<p>This fictional scenario describes a rookie analyst\u2019s first query. Students designed a high-fidelity UX prototype they named DataTrace, based on \u201cSusie,\u201d an entry-level analyst persona supplied by LAS. Susie has been tasked with looking up an email address that has recently been in communication with a terrorist group from the fictional country Zendia. Susie\u2019s team believes it belongs to a new operative.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>She opens the DataTrace interface and types into the search field.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>\u201cI am a new network analyst and need help querying an email address that we suspect is being used by the Zendian terrorist organization in relation to a bombing in the Oceania city of Macondo.\u201d<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Because DataTrace was designed to address the anxieties of a new analyst, Susie finds the natural language approach to queries very intuitive.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>At the end of the day, Susie has run several queries and analyzed a range of data. She is ready to review her activity and submit an analysis summary to her mentor. She expands the data basket where she\u2019s been dragging and dropping relevant information for the AI to synthesize in the background. The data basket has two tabs.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>The first tab highlights her activity throughout the day. She can share that with her mentor and refer back to it the next day as a reminder of where she\u2019s left off. The system pulls out specific details such as the resources she\u2019s accessed, the queries she\u2019s run, and the results of her analysis.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>On the second tab, the system automatically summarizes those results using natural language processing. The system points out areas that were not covered by Susie\u2019s analysis such as detailed content analysis and an insufficient understanding of IP addresses at the bottom of the page. The AI toggles on filters to either suggest areas of improvement or expand the summary based on the information Susie dropped into the data basket. She has the option to edit or regenerate the summary, but she likes the way the system summarized her work and made it easy to share it with her mentor to review her work. She believes her analysis will help her contribute to her team\u2019s mission.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading -->\n<h2><strong>Mind The Gap<\/strong><\/h2>\n<!-- \/wp:heading -->\n\n<!-- wp:heading {\"level\":3} -->\n<h3><strong><em>RedFlag for Josh, a junior analyst who is struggling to understand when his data sources have gaps<\/em><\/strong><\/h3>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p><em>Designers: Aimsley McDaniel, Sophia Milligan, Leighann Vinesett, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:embed {\"url\":\"https:\/\/vimeo.com\/975431852\",\"type\":\"video\",\"providerNameSlug\":\"vimeo\",\"responsive\":true,\"className\":\"wp-embed-aspect-16-9 wp-has-aspect-ratio\"} -->\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/vimeo.com\/975431852\n<\/div><\/figure>\n<!-- \/wp:embed -->\n\n<!-- wp:paragraph -->\n<p>This scenario describes how an analyst with more intermediate experience determines what data they are missing. RedFlag is a high-fidelity UI\/UX prototype created by the second team of students. It\u2019s based on the fictional analyst persona \u201cJosh,\u201d a junior analyst with a little more experience than Susie.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Josh begins his day by resuming the active investigation into the bombing in Macondo. In RedFlag\u2019s main panel, he reviews a notification he filed last Friday alerting him that the data from the IED drone\u2019s RFID chip is corrupted. Josh quickly examines the notification details and reopens the RFID database Scan Shield to refresh his memory of what he was querying for \u2013 information about the drone\u2019s flight path before the bombing.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>In the interface, Josh sees that 100 rows of data are corrupted. RedFlag\u2019s AI-generated \u201cNext Steps\u201d feature indicates that Josh needs to clean his data before beginning his analysis. He is familiar with the suggested data cleaning process and clicks to begin. RedFlag\u2019s AI recognizes the language of the unreadable data as hexadecimal code and suggests a way to translate the data. Josh accepts the translation and proceeds to the next step of the cleaning process, data deduplication. Josh sees the AI has flagged every duplicate in the dataset, not just those he believes are relevant to his analysis. He quickly edits the parameters to only select rows of data that are identical and RedFlag\u2019s AI regenerates the selection. Josh accepts the changes and advances to the last step \u2013 removing missing data. RedFlag\u2019s AI highlights three empty rows that can be removed to complete the data-cleaning process.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Finally, Josh scans the clean data to validate that the process was successful. Feeling confident, he resolves a RedFlag notification and reruns his initial flight path query on the newly cleaned data. RedFlag has made it easy to see inconsistencies and gaps to address in the data and simplified his data-cleaning work.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>While he waits for this query to complete, Josh begins setting up a new query in a CCTV database commonly used in Oceania. He structures his query to search for CCTV footage from cameras within a five-mile radius of North Duke Street where the bombing occurred. As Josh writes the query, he receives a RedFlag notification alerting him of a spelling error. Josh expands the notification and sees that he has incorrectly spelled Macondo as \u201cMakondo.\u201d This has the potential to return results from outside Oceania and break compliance. Josh quickly corrects the spelling and runs the query.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>As his results appear, Josh sees there\u2019s a large chunk of video footage missing, potentially indicating that the cameras were not functional for multiple days. He clicks the gap area in the visualization and discovers that the software was unable to retrieve CCTV footage from April 6 through 11th. This means that any video footage of the drone\u2019s flight path on the day of the bombing is missing. After ensuring that this gap is not due to an internal collection error, Josh checks the \u201cNext Steps\u201d in RedFlag which provides him with two possible solutions that may help him understand why the footage is missing. Josh sees that he can either expand his search to include commercial CCTV footage or start a new query for maintenance reports. After noticing that the maintenance report search will be faster, he proceeds with this option.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading -->\n<h2><strong>You Can\u2019t Do That!<\/strong><\/h2>\n<!-- \/wp:heading -->\n\n<!-- wp:heading {\"level\":3} -->\n<h3><strong><em>ComplAI for Michele, an experienced analyst who runs a non-compliant query<\/em><\/strong><\/h3>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p><em>Designers: Soumya Batra, Aashka Patel, Leah Tatu, Gabrielle Thorpe, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:embed {\"url\":\"https:\/\/vimeo.com\/975432143\",\"type\":\"video\",\"providerNameSlug\":\"vimeo\",\"responsive\":true} -->\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/vimeo.com\/975432143\n<\/div><\/figure>\n<!-- \/wp:embed -->\n\n<!-- wp:paragraph -->\n<p>The third scenario describes what happens when an analyst queries something for which their intelligence agency does not have the authority to access; a non-compliant query. It is from the perspective of \u201cMichele,\u201d a seasoned, mid-career analyst. The students designed a widget that helps analysts like Michele maintain access compliance while searching for intelligence leads. Pronounced \u201ccomply,\u201d ComplAI features alerts about data protection laws and the ability to automatically schedule appointments with legal experts.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Michele\u2019s task is to find leads on Zendia\u2019s military tactics, particularly the use of drones in armed conflict. Using the ComplAI interface, she searches a database of online transactions to look for links between SkyOne drone manufacturing and Zendia. Michele also types in a second request asking the AI to provide appropriate compliance recommendations. As she searches, she adds a justification note that she is analyzing purchase data for Zendian-manufactured drones to uncover security breaches and their link to a bombing using user interactions and time stamps.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>While she\u2019s analyzing the results of her search, ComplAI alerts her of an update to the European Union\u2019s GDPR data protection law. The system flags Michele\u2019s query as high risk for potential compliance violations. To learn more about this assessment, Michele uses the ComplAI chat. She inquires about regulatory guidelines related to purchase and transaction history. She asks a follow-up question asking for some examples of regulatory criteria in response. ComplAI suggests contacting a lawyer and displays an appointment booking module. She adds it to her calendar.&nbsp; It also points out the potentially non-compliant parts of her query and provides the source of the compliance breach. The AI suggests how to better frame her query and gives her an option to generate a risk-free compliant query, which she accepts and continues working.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading -->\n<h2><strong>Crossing the Streams<\/strong><\/h2>\n<!-- \/wp:heading -->\n\n<!-- wp:heading {\"level\":3} -->\n<h3><strong><em>Spine for Miguel, an expert analyst who struggles to combine information from many different intelligence sources<\/em><\/strong><\/h3>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p><em>Designers: Olha Novikova, Parinita Das, Vaishnavi Parni, Graphic &amp; Experience Design, \u00a9 NC State University, All Rights Reserved<\/em><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:embed {\"url\":\"https:\/\/vimeo.com\/975430742\",\"type\":\"video\",\"providerNameSlug\":\"vimeo\",\"responsive\":true,\"className\":\"wp-embed-aspect-16-9 wp-has-aspect-ratio\"} -->\n<figure class=\"wp-block-embed is-type-video is-provider-vimeo wp-block-embed-vimeo wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\nhttps:\/\/vimeo.com\/975430742\n<\/div><\/figure>\n<!-- \/wp:embed -->\n\n<!-- wp:paragraph -->\n<p>Michele, Josh and Susie have all been working on different tasks related to intelligence gathering and analysis for the bombing in Macondo. Their team leader \u201cMiguel\u201d is an expert analyst, and LAS shared the following scenario with the design students describing how an expert analyst may approach synthesizing data from many places. The final group of design students created a prototype of a user interface for him called Spine.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>At the start of the workday, Miguel receives an email from his agency\u2019s headquarters that a bombing killed two people and injured others in the city of Macondo. He begins his investigation in the Spine software by setting the day\u2019s goals and objectives. He selects the case type (terrorist attack) from the drop-down menu and inputs the case details. Miguel enters the time, date, location, and description of the bombing scenario for his team. These inputs inform the AI about the context of the case.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Miguel then adds case objectives and assigns them to junior analysts. He asks Josh to find suspicious activities through the networks in Macondo and Michele to analyze drone purchase data in Zendia. The AI recommends related datasets as useful starting points for the junior analysts. Miguel accepts some of these suggestions but he also adds a network dataset. He saves the goals, objectives and context and sends them to the junior analyst, Josh.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Josh receives a notification from Miguel asking him to look for suspicious network activity in the bombing area. Josh considers the recommended dataset and then he begins with the cellular network dataset. Josh inputs a prompt in natural language that generates a query using appropriate syntax. Josh requests data for WiFi connections in the cafe\u2019s vicinity one day prior to the attack. He wants to identify potential suspects who utilize the network to connect to drone or other suspicious devices. Josh runs the query but he does not find any suspicious activity. Josh realizes that his query did not produce enough results because the time frame and the area were too narrow. So he broadens the parameters. He then discovers that a specific device has connected to multiple public WiFi networks within the specified time frame. This suspicious activity presents a significant lead. Excited, Josh makes sure to input the query, its justification, and findings, and then adds it to Spine.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>While Miguel is running his own queries, some of his teammates queries appear in the team window labeled as outlier queries. The outlier flag could indicate a syntax error, a compliance break or perhaps a unique successful query. To overview the AI-identified outlier queries, Miguel cross-checks Josh and Michele\u2019s queries.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Miguel examines one of Josh\u2019s queries that is marked as an outlier. He discovers that Josh has formulated a unique approach to the query that yielded particularly promising results. He then reviews Michele\u2019s query and prompts and discovers that her query produced broad results that might lead to compliance issues. He later mentors her in person regarding the compliance dangers.&nbsp;<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>Miguel finishes his daily task and starts crafting a team report. The AI generates documentation based on the input context, objectives, queries and findings. The results include executive summary, key observations and tradecraft analysis. Miguel can make edits to the AI-generated reports and cross verify them with the findings from his junior analysts to form a bigger picture of the investigation. Additionally the AI recommends refining future tradecraft and investigation processes providing Miguel with valuable results. Once Miguel is content with the report, he can seamlessly export it and share it with senior leadership at his intelligence agency.<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:image {\"id\":3782} -->\n<figure class=\"wp-block-image\"><img src=\"https:\/\/ncsu-las.org\/wp-content\/uploads\/2024\/09\/Armstrong-Design-Students-2024.png\" alt=\"A professor is seated with a dozen students gathered behind her, smiling.\" class=\"wp-image-3782\"\/><figcaption class=\"wp-element-caption\">Professor Armstrong, center, is the director of the Master of Graphic &amp; Experience Design (MGXD) program at the College of Design. Her students worked with LAS to learn how intelligence analysts at different stages of their careers might investigate a fictitious bombing scenario. As part of their final project, the students were tasked with designing an interface to facilitate an analyst\u2019s investigation into the scenario. The students include Kweku Baidoo, Soumya Batra, Alexis Boone, Parinita Das, Aimsley McDaniel, Sophia Milligan, Olha Novikova, Vaishnavi Parni, Aashka Patel, Rebecca Planchart, Leah Tatu, Gabrielle Thorpe, Leighann Vinesett.<\/figcaption><\/figure>\n<!-- \/wp:image -->\n\n<!-- wp:heading {\"level\":1} -->\n<h1><strong>A Fresh Perspective<\/strong><\/h1>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p><strong>Ultimately, the students created four unique UX perspectives that can be used in future updates to real-world systems. Their final presentations show the true power of academia-government partnerships in safeguarding and protecting national security.<\/strong><\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:paragraph -->\n<p>\u201cThis was a very enlightening experience working with the students and seeing fresh perspective in UX designs, as well as seeing their enthusiasm to work with government personnel to solve real-world problems,\u201d a member of LAS said. \u201cOften, UX is not really taken into account when designing tools that we use daily. The students took our feedback on board and this was evident during the evolution of their designs. The final products did not disappoint! I look forward to working with future students and who knows, the prototypes they envisage could turn into a real-world solution.\u201d<\/p>\n<!-- \/wp:paragraph -->\n\n<!-- wp:heading {\"level\":1} -->\n<h1><strong>About LAS<\/strong><\/h1>\n<!-- \/wp:heading -->\n\n<!-- wp:paragraph -->\n<p>The Laboratory for Analytic Sciences is a partnership between the intelligence community and North Carolina State University that develops innovative technology and tradecraft to help solve mission-relevant problems. Founded in 2013 by the National Security Agency and NC State, each year LAS brings together collaborators from three sectors \u2013 industry, academia, and government \u2013 to conduct research that has a direct impact on national security.<\/p>\n<!-- \/wp:paragraph -->"},"excerpt":{"rendered":"<p>A Fictitious Terrorist Attack \u201cIn 2019 a bombing killed two people and injured others in the city of Macondo, a mountain town in Oceania. A commercially made drone fitted with\u2026<\/p>\n","protected":false},"author":13,"featured_media":25018,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"source":"","ncst_custom_author":"Katherine Kershaw","ncst_show_custom_author":true,"ncst_dynamicHeaderBlockName":"ncst\/default-post-header","ncst_dynamicHeaderData":"{\"showAuthor\":true,\"showDate\":true,\"showFeaturedVideo\":false,\"caption\":\"LAS is a collaboration between NC\u00a0State University and the National Security Agency. NC\u00a0State College of Design students worked with LAS to learn how intelligence analysts at different stages of their careers might investigate a fictitious bombing scenario. As part of their final project, the students were tasked with designing an interface to facilitate an analyst\u2019s investigation into the scenario.\"}","ncst_content_audit_freq":"","ncst_content_audit_date":"","ncst_content_audit_display":false,"ncst_backToTopFlag":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-25029","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"displayCategory":null,"acf":[],"_links":{"self":[{"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/posts\/25029","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/users\/13"}],"replies":[{"embeddable":true,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/comments?post=25029"}],"version-history":[{"count":1,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/posts\/25029\/revisions"}],"predecessor-version":[{"id":25030,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/posts\/25029\/revisions\/25030"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/media\/25018"}],"wp:attachment":[{"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/media?parent=25029"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/categories?post=25029"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/design.ncsu.edu\/graphic-design\/wp-json\/wp\/v2\/tags?post=25029"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}