Association of Law Enforcement Intelligence Units (LEIU) and International Association of Law Enforcement Intelligence Analysts (IALEIA) Annual Training Conference Course & Instructor Evaluation Report
Anaheim, California April 9-13, 2018 Executive Summary The Association of Law Enforcement Intelligence Units (LEIU) and the International Association of Law Enforcement Intelligence Analysts (IALEIA) Annual Training Conference was held at the Marriott Anaheim, in Anaheim, California on April 9-13, 2018. LEIU was celebrating its 63 rd annual conference and IALEIA was celebrating its 38 th annual conference. The conference was designed to provide LEIU and IALEIA members with practical information on analytical tools, organized crime, gangs and criminal extremist groups, and terrorism as well as training in effective and legitimate applications of the criminal intelligence process. The conference also supported and fostered critical networking between local, state, federal, tribal, and international members. Conference and Workshop Attendance: The conference was well received this year as it continues to be considered one of the best training conferences of its kind where many beneficial member contacts are established. The level and variety of training opportunities the conference provides is well respected among its members and associates. There continues to be significant support to have both organizations combine their annual training conferences. We continued to offer certificated tracks in the Fundamentals of Criminal Intelligence and Advanced Analytical Skills Training, and Criminal Intelligence Supervision/Management Training. All three of these tracks were well received. This year (the numbers in parentheses reflects the attendance in Bloomington/2017) there were a total of 679 (550) attendees: LEIU Members = 212 (215); IALEIA Members = 229 (184); Nonmembers = 110 (103); Sponsors/Exhibitors = 62 (46); Instructors = 37 (36); Staff = 27 (24); and Spouses/Guests = 2 (2). Although budget issues continue to affect many agencies, several agencies still sent representatives because of the good reputation, quality, and timely workshop topics, dynamic speakers, and overall organization of the conference. We anticipated this location would draw more than we did on Bloomington, MN and that was true. We had an increase of about 129 attendees. Although a significant increase New Orleans was still our highest attended training event (798). General Information: We continued to accept bankcards for registration fees and we continued processing the credit card payments through Square. Although we continue to pay approximately 3.5% when we process credit cards without scanning them, by using Square we reduce this to 2.75% when we process at the conference since we have a portable scanner. Additionally, this process automatically sends receipts to attendees saving significant time since we do not have to manually create and send receipts. This year we added additional tablets to process to the registration-related application called On Arrival. This enabled us to significantly reduce the time it took people to register. We also added a scanner capability to capture attendance at our certificated classes enabling us to issue certificates for those classes in a relatively short time (three weeks). This year we purchased our own scanners. Our general 2
attendance certificates were available the last day of the training event through an online link. We now have our own badge printers, tablets, and a router to sync all of the operations. We are exploring (and anticipate going to) the Cvent credit card processing for registrations. This will significantly reduce the amount of time we need to add credit card payments to the registrations (we now have to do that manually). By using this process--the payments are automatically added to the registration site. There will be a small added cost to this but we have negotiated a reduced fee and the increase is reasonably small. Additionally, we have purchased some backup hardware. This allows us to have some comfort in case a piece of equipment stops operating properly. We also added a new badge holder that worked out great. It allowed us to advertise information for the next conference in Orlando, FL, add information about the Wi-Fi code, and place the sponsor of the badge holder on the badge (all done at no cost since we found a sponsor to pay for this). Future Conferences: We need to continue to pre-plan the budget for future conferences. The budget environment, with so much still remaining unknown, remains our biggest issue. We have now booked the April/May, 2019 conference at the Doubletree by Hilton in Orlando, Florida. All conferences have generated local support through LEIU member agencies and IALEIA chapters/members. Comments or Suggestions about the Conference: We received numerous comments and suggestions about the conference. Those comments/suggestions are contained in the following detailed sections. Evaluation Report Introduction This is a course and instructor evaluation report for the LEIU/IALEIA Annual Training Conference held in Anaheim, California on April 9 13, 2018. Attendees of the course were provided with a secure web location utilizing software from Survey Monkey. The first portion of the evaluation dealt with the overall conference (registration process, conference staff, hotel, geographic location, registration cost, Awards Banquet, suggestions for future conferences, etc.). The second portion evaluated each presentation and instructor. The form primarily requested multiple-choice responses to specific questions and allowed for written comments. The allowable responses in the overall conference section were (generally): Excellent, Good, Fair, Poor, and Not Applicable. The allowable responses in the presentation/instructor sessions were: Excellent, Good, Fair, Poor, Very Poor, Not Applicable. There were 190 respondents who started and completed the survey. Evaluation Report Summary Generally, the attendees were very complementary about the conference, the staff, the program content, and the location (Anaheim, California). Approximately 51% liked the inclusion of the sponsor training during the regular sessions. The overall conference evaluation received an 3
average of 4.5 (4.4 in Bloomington 2017) out of a possible 5.0. There were some comments that will help us in the future. The top five rated (three tied for 4 th ) workshops (see pages 26-33) were: 1. Jerry Ratcliffe: Proactive & Predictive Policing 2. Chris Adamczyk: Spreading #H8: Identifying & Responding o Violent Ideologies on Social Media 3. Curtis Davis: Silo-breaking: Intelligence from the Ground Up 4. Rudy Negron: Outlaw Motorcycle Gangs & The Biker Culture Brett Detzer and Kathy Lichay: The Role of Walmart in Combating Social Engineering Scams Ashley Mericle and Lena Grote: Identifying, Vetting & Investigating Local Online Extremist Behavior This is very close to the response to the question: Which Presentation/Workshop did you enjoy the most? However, this section provides a breakdown of the top five courses based on average scores received. Overall Conference Section Summary of Responses Evaluation Methods: Where appropriate, attendees were instructed to complete the online survey instrument rating each listed component in the overall conference using a scale of: Excellent (5 points); Good (4 points); Neutral (3 points); Fair (2 points); and Poor (1 point). In order to determine an average for each component all points were added together and divided by the number of responses provided giving an average rating. In some caseswhere there are only yes or no answers or the response only required comments-there are no average ratings. Additionally, as another perspective, the evaluator provided the percentage of responses that were in the excellent to good categories. 1. Rate the Online Conference Registration and Confirmation Average Rating = 4.6 Excellent/Good = 94% Representative Comments: Suggestions included improvements to registration portal. 2. Rate the Helpfulness of the Conference Staff Average Rating = 4.8 Excellent/Good = 96% 4
Representative Comments: Comments reflected the conference staff were helpful, efficient and friendly. Suggestions included cross training so more than one person could answer registration questions. 3. Rate the Conference Hotel Average Rating = 4.6 Excellent/Good = 97% Representative Comments: Comments reflected most attendees thought the host hotel was great; however, several attendees who stayed at the overflow hotel were not pleased. 4. Rate the Conference Facilities Average Rating = 4.7 Excellent/Good = 99% Representative Comments: Attendees did not like sharing the conference space with another large group. 5. Did you stay at the Marriott Anaheim? Yes = 74% No = 26% Representative Comments: Attendees felt the Marriott Anaheim had great accommodations. 6. Please Rate the Location (Anaheim, California) Average Rating = 4.5 Excellent/Good = 94% Representative Comments: Comments ranged from the area being too expensive and touristy to appreciation for the destination. 7. Rate the Overall Quality of the Conference Average Rating = 4.5 Excellent/Good = 96% Representative Comments: Overall attendees felt the conference offered a great selection of classes. Most people enjoyed the breakout sessions over the general session presentations. 8. The Conference Registration Cost was Appropriate Strongly agree/somewhat agree = 74% Neither agree nor disagree = 23% Disagree somewhat/strongly disagree = 3% 5
9. Did you Like the Inclusion of the Sponsor Training during the Regular Sessions? Yes = 51% No = 8% No Opinion = 41% Representative Comments: Most attendees did not mind the inclusion of the Sponsor Training as long as there were other presentations to choose from. Some attendees felt their presentations came across as a sales pitch. 10. We Moved the IALEIA & LEIU Awards Presentation to the Opening Ceremonies and Re-Vamped our Thursday Activity to a Farewell Reception, Allowing Our Attendees Time to Network in a Less Formal Setting. Are You in Agreement with this Format for Future Training Events? Yes = 96 % No = 4% Representative Comments: Most attendees were extremely happy with the new format 11. If You Attended the Farewell Reception Please Rate It Average Rating = 4.7 Excellent/Good = 70% N/A = 28% Representative Comments: Overall attendees were pleased with the Farewell Reception and felt it provided a great environment for networking. 12. If You Attended the Farewell Reception Please Rate Food Average Rating = 4.6 Excellent/Good = 64% N/A = 31% Representative Comments: Overall attendees were pleased with the food at the Farewell Reception. There were suggestions to add food for those with dietary restrictions. 13. How Did You Hear About the Conference? IALEIA Website/Mailing = 72% LEIU Website/Mailing = 17% From Bloomington Conference (2017) = 6% Conference Flyer = 4% Intelscope = 1% LinkedIn Group = 1% Representative Comments: Several attendees heard about the conference from individuals within their agency/department. 6
13. What Did You Most Like About the Overall Conference? Representative Comments: Comments focused on the variety of classes and networking opportunities 14. Which Presentation/Workshop Did You Enjoy the Most? The presentations/workshops mentioned most (top 5 in order of numbers of times cited) were: 1. Chris Adamczyk: Spreading #H8: Identifying & Responding to Violent Ideologies on Social Media 2. Jerry Ratcliffe: Proactive & Predictive Policing 3. Curtis Davis: Silo-breaking: Intelligence from the Ground Up 4. Scott Keay: The Evolution of the Police Analyst & the Influence of Evidence based Policing 5. Rudy Negron: Outlaw Motorcycle Gangs & The Biker Culture (Evaluator Comment --This question reflects a tally of the most number of courses cited, not a quantitative breakdown of courses based on average scores received.) 15. What Suggestions Do You Have for Future Conferences? Representative Comments: Attendees comments ranged from suggestions on food to suggestions on other presentation topics or topics they would like to see return. 16. Do You Plan to Attend the LEIU/IALEIA Conference in 2019 in Orlando, Florida? Yes = 57% No = 9% Undecided = 34% Representative Comments: Attendees stated it depended on the budget. 17. For the third year we used an Event App and created a self-check-in registration format. We plan to make enhancements for next year (including a faster way to process payments on site). This app has not only allowed us to go green for the past three years it has allowed us to include the agenda, presentation summaries, speaker bios sponsor/exhibitor links, hotel maps, city maps, and an attendee roster, and speaker handouts in a convenient location. Additionally, the app gave us the flexibility to send push notifications to attendees advising of changes to the itinerary and meeting reminders. Please tell us what you thought of the app and self check-in registration process. Average Rating = 4.7 Excellent/Good = 92% N/A = 4% Representative Comments: Most attendees had positive comments regarding the application. 7
18. Did You Like Having N-DEx as a workshop on Wednesday and Thursday or would you prefer to have it moved back to an optional workshop on Monday before the conference started? Yes = 21% No = 12% No Opinion = 67% Representative Comments: Some attendees enjoyed the workshop being on Wednesday and Thursday, others would have rather had it on the Monday before the conference. 19. For Those Who Did Not Attend the Training Event Last Year in Bloomington, What Was the Incentive to Attend This Year? Location = 52% Topics = 31% Cost of the hotel = 3% More budget for training = 36% Representative Comments: Comments ranged from classes offered to department funding. 20. Do You Think Attending the 2019 Event in Orlando, FL will be: Easier = 19% Same = 57% More difficult = 19% Impossible = 5% Representative Comments: Dependent on budget. 21. If You Attended OSINT & Cyber Training Presentation on the Sunday Prior to the opening of the Conference Please Rate Mike Bazzell s Class: Average Rating = 4.9 Excellent/Good = 41% N/A (did not attend) = 59% 22. If We Bring Mike Bazzell Back to the 2019 Conference in Florida to Present Another Class on the Sunday Before the Conference Opening Would You Attend? Yes = 56% No = 16% Maybe = 28% 8
23. This year we also added a 4 hour block of training on an Introduction to Web GIS for Intelligence Analysts presented by esri. If you attended, please rate? Average Rating = 4.2 Excellent/Good = 15% N/A (did not attend) = 81% 24. If we offer another introductory GIS class by esri at the 2019 Training Event, would you be interested in attending? Yes = 55% No = 45% 25. If we offer a more advanced GIS class by esri at the 2019 Training Event, would you be interested in attending? Yes = 55% No = 46% 9