eSign Summer Camp Evaluation Made Easy

E sign summer camp evaluation

okay today I have to give away three it will start off by let you know there is a giveaway I've got an e-book to give away it's written by Mark breakfast who's the founder and CEO of the organizational work for mr. Webb training and assessment and we've got an e-book to give away and I thought well how do I do that and I've come up with a plan so for those of you who are on Twitter it's a good plan because it involves 20 all you need to do is tweet something today about this session so maybe it might be a tool you find fascinating or something that you haven't thought about before a way that you can integrate technology into your evaluations and to do that just use the hashtag dtw ed shorts which is the hashtag for all of today and just make sure I see it as well by mentioning my handle at going in now so might will take a few seconds just jot that down if you're active on Twitter you'll have that you just do that any time during the session sale or even after the session I'll have a look at those late tonight and I'll pick a winner and I'll contact you and we'll get an e-book of the training tool kits here alright let's get started with the content now today's topic is putting the e into evaluation ways to improve evaluation by using simple and cost-effective technology so we don't have a limitless budgets we understand that as training providers we don't have limitless budgets so what we've come up with is a group of tools that you can use to help you with your evaluation evaluation is very important for us in training organisations firstly it's the way we collect feedback that's the way we look at it's the way we make improvements in mr. Webster 13 years I know that we just keep making improvement after improvement after improvement based on the fact of the feedback that we get from employers from clients from our own staff and from our students and we employ a variety of technologies to help us to do that and it's been very very powerful the best way to improve is to get feedback and to analyze it and today we're going to be presenting you with a variety of e tools to help you to improve the way you collect information that will help you moving forward this is also an aside to this as well which is the ability to satisfy your requirements if you're an RTO then you have requirement to evaluate and to validate what you're doing and this can also assist with that but I see that as a bit of a side topic because regardless of that evaluation is the key to making improvements and moving forward when you're training organization about me I II am a lead assessor and also the team leader for our learn of success attainment mr. Webb i'm coming to you live from the metropolis of culture which is just north of brisbane today and sunny Queensland isn't as advertised today it's a bit cloudy and miserable but we're looking forward to having a fun webinar with you if you want to contact me after today the details are currently on the screen or will show this slide at the end of the presentation today email neat contact me through Twitter whatever works best view and/or give me a phone call happy to chat with you and connect them answer any five questions you might have after today as we move through the session data to encourage you to ask questions I probably won't address most them during the session but just after the session completes oh I've allocated about five minutes to go through some of the questions and answer them if I don't get through all the questions I suspect that will be the case i will get back to you after the presentation so they all look to contact you so if you contact me by email or through Twitter I'll have your contact details and i'll be able to answer any questions you have so please connect with me I look forward to helping you beyond today alright we've talked about the little competition we've got going today to find something useful with well please send us out there into the twin of us and they look forward to reading all your feedback there let's get started we've got a polo this helps set the scene for what we're going to be doing today it's about using eTools for evaluation so I thought a good starting point would be to have a quick poll you'll see the polling information on your screen it looks like a little check box you click that check box you'll be able to choose yes or no the question is do you currently use e tools for evaluation every week now I'm sure you do conduct some sort of evaluation it might be manual paper-based forms we collect surveys from students certainly a lot of training organisations do that but do you currently use each tools as well other some electronic tools you use to conduct your evaluations popular yes or no to the pole I can see that the answers are starting to come in give it a few more seconds to hopefully collect a few more responses just look to the little tick box if you're looking for where to do that looks like we've got a relatively even split so far we've got something on the yes and something on the know we've got a relatively small room too though we've only got about five people in the room looks like everyone's just here now the live audience I understand you can't click the box so it's fine I've got a solution for you if it's a yes please put your hands up with enthusiasm right now if it's a yes for you and for the known folks pop your hands right up there now if it's a no for you and please let us know okay all right so we'll just say those poll results Chris are you able to bring those up for us chris is helping us today if not i will bring them up I'll do that right now there we are so there's the published responses from our web-based we had three nose and one yes and then we had the feedback from the rooms as well so I can't see what's happened in the rooms are can't see you visually so I'm gonna go with maybe there's quite a few noses as well there which surprises and disappoint but you know that's the way the world is until you get exposure to some of these tools and see the power of them it's difficult to bring them on board and were found really fascinating about marks presentations they did catch bits and pieces just at the start of his presentation before I stepped away to get ready for this one and what I noticed was that mark started by talking about your fears and fears do hold us back and fears are one of the main drivers why we don't embrace technology what I'm hoping to do today is I'm hoping to follow on a little bit from what Mark presented in terms of showing you some tools that are very easy to use very very in fact one of the tools i'd say today was actually designed for primary school children and it's extremely easy and it's a nap so we've got that in there and we've got more complications and we've got some pretty serious high powered tools as well but there should be something for everyone in this presentation today that you can use and take away that's going to help you develop improved evaluation processes for your organization all right so we'll just pop the hands down a couple of people through their hands up which is great and we've done that now and we're going to move forward first question have you set up an online survey three hands up if you're doing the audience throw your hands up if you're online throw your hands up as well Lynn's thrown her straight up here and up here a high achiever today lineare you were here early Jason's got his hands up in stow N and Liz and I presume lots of folks in the audience as well that's great i'm going to throw those hands down and then we got to give you a chance to answer another question for us the hands are down here comes your next question folks have you set up an online meeting or a webinar takes a little bit more skill to do this Jason straight in Liz we've got a yes from you as well how we traveling in the audience the audience back home so so to speak have you got some hands up there alright let's drop our hands down and lower all the hands and we'll ask one more question third one have you uploaded any items to Dropbox or box box used to be called box.net now they just call it box we've got a yes from lynn and a yes from Jason there are high achievers apparently which is great which is great and I presume we've got some yeses in the audience as well which is terrific all right we'll drop all those hands down and we'll also reese reset our poll as well because we'll be using that again a little later on well guys let's get into some hardcore content so what he told to use now for evaluation if you're using a couple of e tools currently them in the chat box that would be good of interest to see which ones you using and if interesting see if they correspond with the ones we're using as well today we've got Bob helping us at the moment over in the room thank you bub great to see you there if we got need tools that you're currently using that you want to tell us about folks surveymonkey from Liz good on your lids we go SurveyMonkey from Jason as well surveymonkey is on the list today in fact it will be about the first one we talked about but I won't be doing it in great detail because a lot of people have you survey monkey before not necessarily the setup service but to respond to surveys it's very typical so that being the case will introduce that as one of the options today all right folks let's move forward with the slides so there's only one side a theory today and this is it you're looking at it right now the only theory slide everything is very practical in hand hardcore after this slide basically sludge is designed to give you some ideas about how you use a valuation more effectively now what we've got on the slide is we've got an evaluation cycle and you can see that there's five parts to the cycle starts with evaluation it starts with planning so we need to plan what is it that we want to evaluate how might we do that and you create a strategy for evaluating the success or failures or problems or challenges or opportunities of the training or the projects or the programs that you are the delivering or you're planning to deliver after you've been through that planning process you then implement it put it into action so you create the program you create the training program you get it rolling and after you implement it in your den start to analyze it now one of the interesting things because today is often that's difficult to analyze and report and use if you don't have that as part of the planning cycle often you have to put these tools in place early you can't go back and look at survey results if you didn't have the survey in place so it's useful before you start a program or before you revamped any type of training program or project or course to think proactively about how are you going to evaluate and what you need to evaluate so you plan you implement your analyze then you report you create reports and often with a lot of tools that we're going to be showing you today they will create those reports for you don't need to sit down and document and write pages and pages of reports that's a little bit old school and after you've done the reporting you use those changes you use that information and factor it back in their planning such a cycle that goes round and round and round now the tools that we going to be looking today at today we've put them into six categories and you can now see them up on the slide they don't correspond perfectly to the five parts of the cycle I've tried to put them in areas where it but they might be used most often but that's not necessarily the case and you can see the six types of tools that we're going to be looking at today support tools checking for understanding audience or responsible polling tools collaboration tool survey tools and infographics and basically what we're going to be doing through this presentation today is we're going to be moving through those six types of tools really starting with the survey tools moving through to audience response polling tools the third one we're checking for understanding the fourth one collaboration then infographics and then support tools so that's the six sections we're going to moving through today and the first three or four are going to be a longer one so don't panic about time I realize that we've got to finish up by 10 15 I know you need morning tea and I will not make you late for morning tea I promise so we'll move through these six areas quite quickly especially the last few so survey tools the first one what sort of survey tools are available okay I've got a list on the slide now at the end of the webinar today i will be giving you a way of obtaining all of these resources so please don't feel compelled you go sit there and scratch out all these names and website addresses because at the end of the session today i'll give you a couple of ways you can obtained all these resources so i'm not going to be keep their keeping these slides of all different tools duck for very long they basically an introduction to let you know there are plenty of options and we will run through some of them in more detail in this case here we're going to look at the first for that on the list and I'll be leading you through those I also recommend to your Yap google forms a good option lot of people are very comfortable with google documents and Google Forms is very easy to use as well and works fine telling pad and survey / we are apps so if you're looking for an apt solution that you can use with your phone or your tablet rather than a disk-based computer-based tools to use then there are apps are available and telly patents survey we are very easy to use and I recommend those to you however some of the other options are firstly SurveyMonkey identify them SurveyMonkey but it deserves an honorable mention at least because SurveyMonkey is easy to use a lot of people have seen it before and use survey monkey on many occasions so as a result don't hesitate to look at that and there's a free plan to get your started which is great but another option of looking for something different is quick surveys and then says on the screen quick surveys is a free so they tour with lots of options it gives users the option to the mix and match different types of questions you can add me to see a survey by posting it on a blog a website or a discussion forum at discussion forum or you can email it which is magical so you can send out the survey you can track who's responding and who has an excellent product quick surveys so I recommend that as an option to compare to consider if you're not using surveys in electronic format yet here you can see the sign up plays it's quite easy on the right inside you put in your name your address your password and you create your account and you're off to the races it's that simple observe a is another option if I describe themselves as being surveys made easy gives you multiple choice options open ended questions it is really easy to use of survey as well so in 45 minutes today we're not going to have a chance to explore any of these tools in detail but obviously there's another great choice if you're looking for a new type of software to use or programs use to conduct surveys here you can see the one of the initial slides prob survey it's very easy you can see that there's a 30-day trial which is free you create your title you create the survey from scratch or copy from an existing one that you've already got this can be a time saver and it's got a video to show you how to do it very very easy I've got a question for now how do you think you could use one of these survey tools in your own training programs I'm interested in your feedback in your contribution here if you could type your answer into the chat for those who are online that would be great and if somebody is in the main room you can type it in for us that would be great as well I believe that crystal is back with us if you have a chance to pick up one or two responses and put them in the chat that would be great any ideas on how you can use these surveys I know it takes a little time to type these responses the brain is to get the gear you have to transmit the information to your hands and start typing and it literally takes a few seconds I think improving digital literacy for students are really who come from backgrounds where they never used a computer before you could develop a very easy kind of survey and you get them you know clicking and dragging and doing all kinds of things that they need to do and it'd be fun awesome also and what what's your name Karen barber hey Karen that's a that's an excellent response what's interesting karen is that just recently I've noticed with some of the new survey tools that are coming out as well they are getting really really good at facilitating those types of options so the days of SurveyMonkey we just click a response and that's the only thing you can really do I can see over the next two to five years huge changes in this area in terms of the other click and drag and play and do interactive things in the survey interacts with you and changes questions as you move through the survey franziska to culture this to a local port hello these tools are important when students are undertaking projects when their residual Sicilian topic and they can get a lot of responses so that they can come up with the project especially seven months agree entirely that's great and he goes back to what I said earlier that if you're not making a deliberate effort to collect the feedback it makes it really hard to make improvements all right guys might hold it there for a second and we might move but would thank you very much for your responses from the room I can move on to the next area which is going to be fun oh there's one more survey i want to mention c1 will serve a type let's click Choose now coatsy's is pretty simple and that does something quite different to the others there is some functionality I believe it's an observation to switch duplicate eclipses but what click Choose does that's unique is it gives the opportunity to actually do a survey based on videos so if you've got multiple videos in you're looking for the back about those videos you can have different videos as shown on the screen to look at and people can vote for their favorite video will provide feedback about those videos very very clever in this age of video over the next 12 months to five years video is going to go crazy I read recently that the amount of video that is getting up blows into places like Facebook and Twitter and YouTube over the past month or so is amazing it's a huge logarithmic curve of the amount of video that's being uploaded and Australia we have some bandwidth issues sometimes so it makes so little slower in some respects well hopefully initiatives like the NBN are really going to help us with that vo is the next big thing in terms of providing content and seeking feedback so sites like click Choose are going to become more popular for that reason we must get that one let's move on to number two audience response or pulling tools so there's a whole batch of pulling tools you can use and I've got a bunch of them on the screen there and again these resources will be made available to you afterwards and I'll give you a mechanism to do that at the end of the webinar today but I want to quickly mention a few honorable achievers and the first one is poll everywhere when I first saw poll everywhere my life changed it is an amazing amazing tool what poll everywhere does is it gives you the opportunity if you're in a face-to-face environment if you're conducting face-to-face training of getting feedback immediately through electronic means so rather than ask people to sometimes put their hands up it can be a little bit embarrassing depending upon the type of feedback you're after you can give your participants a chance to provide feedback I've just basically through their mobile device they can text a response they can gather website and vote there's lots of options and as it says on the slide it makes engagement happen and it's amazing that creative things you can do with software like poll everywhere one of the things I love about Polly where is that has a add-on extension that your ad in the microsoft powerpoint so you can have a powerpoint on the screen and it will change as the results come in based upon how your students are boating very very powerful stuff so highly recommend you have a look at that it is extremely easy to use and it's free to get started with poo everywhere they have a free plan as well as you can see on the screens the content adapts on the screens based upon the votes that you receive which t is another free and easy use pulling too stration is not required by listing you're basically putting the question and away you go it's as simple as the screen you see in front of you you ask you a question you pop in your answers you create the pole and you collect results it is very very easy and you don't even need red stuff Renta renta it has become a little bit of a cult survey product it does something is very different it's basically setting up a community of people who are conducting polls and responding to polls and then there's polldaddy and paul daddy is the industry leader if you want something more powerful with better options for conducting polls polldaddy is fantastic has some advanced functionality as it says surveys your ways and handling this pricing it's got a free plan otherwise two hundred dollars per year or the corporate plan of eight hundred and ninety-nine dollars per year for corporations and organizations do this serious polling and it's a fantastic product paul daley it's got lots of bells and whistles if you want high-powered poly it's a great option for you all right did you get a chance to those who are playing along at home I like to keep you guys engaged and give these guys some things to do so I'd like you to pop into the chat how you could use those polling tools give you a few seconds to do that and we might take one or two responses from the class group as well if we want to facilitate that at the moment that'd be fantastic I'd be very interested to hear what you guys have the same terms of the 18 use poles thanks oh and it's Karen again I just thought I'd had an idea that I'm doing little video clips for language learning and i think if i use paul daddy i could find out from students what what they like but they didn't like and also i could get information about what kind of video clips they'd like to see that I haven't been producing so it would be great information because what I want to produce I want it to be useful okay I understand that totally Karen and I think that's brilliant i love what you're doing it language anything involving language especially language teaching can be tricky because sometimes you have that huge variety don't you are people who have its skills and ready to go and then people who are struggling so i can understand that in that environment Polly would be very very valuable one more response there from the audience to vote Reynold and Eddie crane I will work at American Institute and to use that joining point audience response system and to use it for different purposes for revision in anatomy and physiology and physics and chemistry and they also use it for feedback collection is a nice break as well it sounds like you've got it covered that's great that's really it sounds like you're using it for lots of purposes and that sounds great don't know what add this is lovely see smiling happy ladies are you guys would like to having a bit of fun there which is fantastic all right we might move on we got plenty more slides to go through and I know we've got limited time we need to finish in about 12 minutes so here's a tip for you moving forward have participants create their own poles to reinforce content and support checking for understanding in activities this is a very clever little thing to do so get your participants to create their own poles and then they can pull other students in the class its way of them analyzing and conceptualizing the information that can help them so there's a bit of a tip moving forward we're up to number three checking for understanding tools how do we help check for understanding so it's one thing to do a survey it's another extension to do Pauline but how can we check for the students cool comprehension of what's going on how can we check for understanding and we are moving a little bit in the direction here of heading towards testing so if that's something that you want to be using eTools to help you with there's a list of full on the screen and we're just going to look at one we get a look at once it's very innovative and very bizarre but very clever and that is Kahoot and the crazy name of coot matches the crazy philosophy and approach what they do is they use a simple and speedy drag-and-drop creator tool to manage cahoots and the credits can be quizzes surveys all polls trainers can Lord State cahoots on the screen in front us or online and then people can join through their personal devices and all happens in real time and it's got gaming elements so if you've got a class where you want to conduct a test and maybe it's something which isn't going to be formally assessed but you just want to check their understanding how about make a little bit of a game of it and that's what kohout loves you gives you an opportunity to do now the screen on the board at the moment is take another snapshot of a video you go to the coop website the first thing you see is this video which only goes for about six seconds but it captures the spirit of curb my love it and what it's good as it's got a classroom of primary school children sitting there and they're obviously doing something on their computer and there's two boys in the front of the room and then just put in their answer they're just putting their final answer the cookie and you can see them they're literally going like this and praying that they've got the right answer and then it comes up on the screen they got the right answer and LG its ease and punching they're excited these boys they have won the quiz they've won the test and the rest of clap the rest of the crowd erupts into spontaneous applause for them and if you can create that type of exciting environment in your training room you're doing something marvelous who allows you to do that it's easy to go their site easy to get started and a strongly recommend cahoot for you all right I had planned on a 30-second stretch break here so it's in the classroom situation stand up have a bit of a stretch you know make yourself feel good if you're alone if you're by yourself have a bit of a stretch air punch yourself not hip self but air punch yourself into the air and this is my designated water break to have a drink to keep me hydrated and keep me happy for the final run to the finish let's go we're not finished from the wet not far from the finish line we've covered the first three areas we've got three more to go and these three will be much quicker collaboration is the first one here's a bunch of collaboration tools that you can use to get together with other people part of evaluation is not doing it in a sign not doing it by yourself but working in teams working with others and these tools enable you to do that we've got him chat at the top which is a very popular program very easy to use we've got today's meet we've got blab look into my eyes I need to give you a very specific warning about blab blab blab runs surveys and in its most recent serve serve a lab identified that the average blab user is using blood for 60 minutes a day lab is a communications tool we get together with up to three other people and live stream video to each other and to an audience that's watching now the downside of lab is it's you can't set up a private lab at this stage from sure that that option will come soon but if you don't mind sharing some information publicly then blog would be a useful way of collaborating not necessarily evaluating student feedback maintenant secure environment but if you want to get together and talk about anything lab is a magnificent place to it but I do warn you it is addictive and I haven't fallen prey to the way of addiction yet but it is a fun and crazy place and people are enjoying black there's also other options here chatty back channel which is a very serious high-powered option and my editing buddy is the one that I reckoned that I mentioned earlier which is designed for young primary school teacher so sorry young primary school students very easy to use it's a nap and then there's canned responses I want to put that on the list because canned responses is probably one of the most easiest to install pieces of software or ad on the software that can save you an incredible amount of time it's specifically for people who use google mail if you use gmail google canned responses and have a look at what it does it enable you to set up some responses that you use typically over and over again if you wanted people who finds that you typically giving the same sort of response to lots of people canned responses can save you hours per month so have a look at that as an option the collaboration tool that we're focused on here is HipChat so just a couple of quick screen grabs from HipChat and this today's meats and there's blab dangerous very dangerous you can sit there and be a voyeur and watch people all you can go online either through your desktop or three a portable device number five is infographics and we'll start off here by showing you some examples of him for graphics it's basically a visual representation of information or data so you can see that for people who are visual learners and I am one of those it's a magnificent thing it can communicate details and results so quickly to anybody is watching and people are addicted to these things they see an infographic and they will they will look at it they want to know what's going on and it's so much more effective than just writing out the results of surveys etc a well-designed infographic like the one below can help you simplify a complicated subject what's an otherwise boring subject into a captivating experience sounds fantastic but the truth is that they work and a lot of surveys have found that info graphics are very successful and one of the hot things on the internet at the moment do use infographics yes or no let's go to the pole so go find the pole for those of you are in the classroom here comes your chances where's the yes who's used infographics who's creative infographics of the key question how are we going with the yessirs in the classroom for people who've created infographics somebody's can have to be the spokesperson how many if we got I can't not a lot happening hey I can't tell you that amongst the online participants we've got four nose & 0 answers at this day so obviously a lot of people haven't produced infographics yet and that's fine that's fine i encourage you to have a look at it especially if you fancy your design skills give it a go have some fun with it all right let's move on there's a list of infographic tools that you can use piktochart step silk etc etc etc lots of variety there and picked a chart is a very popular one just a couple of slides giving you an idea what it looks like if you go and have a look and you can choose infographics reports banners presentations lots of options finally support tools and support tools are there to help us finalize the process and what we've done is we've listened for their Evernote Dropbox easily do and hightail basically support tools our way of not just collaborating and sharing dialogue but of recording materials and sharing those materials so many of you are probably familiar with Dropbox Evernote is like a note system and very very powerful it's very cool and I use the free version of Evernote and Dropbox and it gets me by fine so please don't think these things aren't across to a lot of money because that's not the case here's one tip for you when considering support tools by leaving evaluation data and cloud storage it announced it enables multiple people to access and manipulate the information so don't hesitate to use those cloud-based tools like dropbox and evernote all right so there's our overview we've been through the six areas and what I'd like to do is list three in tools that you'll try as a result of this workshop to help you that with that I'm just going to quickly browse through the six screens again so what are the three that you're going to try their survey tool it's caught your attention that you think might be worth again for those of you playing at home you can pop it in the chatter on a pad I'm not going to go through these answers with it and just chop them on a pad save for those of you who have a classroom situation just write your answers down on the pad is it a polling tool that you're going to start using and start investigating after today's webinar well maybe a checking for understanding to a light coat collaboration tools have we drawing you into the blab net haha maybe the my editing buddy start off small have a look at that it's designed for primary school kids you can manage it I promise infographics piktochart and lots of options there alright and support tools Evernote Dropbox is it time that you've been worn down after lots of people asking you if you have a dropbox or Evernote and time to take a launch and take the plunge what is your next step will basically your next step folks is exactly as we see on this slide we have a young child and the young child is having a play and the untold is having a play with some tools and that's what I'm encouraging you to do today so after today when you leave this room go and have a play with some tools go home pick up the resource list i'll tell you how to do that in just a second and go and have a play he can't break it nothing fatal will happen as a result of you having a fab so you having some fun with the tools and how do you grab the list of resources that are provided to you well basically if you go to our website we have training ezine yours in training is on which is a newsletter if you subscribe to that i'll be watching that over the next 24 hours if you subscribe over the next 24 hours i presume that you'll be coming from the seminar and i will send it out to mr. with edu by you you'll see the sign up box on that page if you don't want to do that need philosophically opposed to providing emails and subscribing to our email list about training and assessment then just email me that's fine have no issues with that at all and so the website's address to sign up for the newsletter mr. webby be a you and my email address is dean out at mr. Whedbee eww I do want to thank you for attending today and also want to thank Chris and the team at some shorts for hopping on technical side of things is quite a big undertaking for them having classrooms integrating with webinars and they've done fantastic from what I can tell say thank you to Chris enmity and also I want to thank the department as well very grateful to the department of training and workforce development for putting on the summer shorts and really appreciate the invitation to present today if there's I know we're just about a Money Thea there a couple of quick questions that we'd like to address before we wrap up in you make me laugh he said Donald needs training yes Donald in the news at the moment for those who missed it Donald Trump recently signed up for our yours in training newsletter thanks for noticing that you've given me a good laugh area okay it looks like it's all good from the room for some sorts guys I believe it's morning tee time so please take a break at kept some morning tea have a drink rehydrate if you have questions please don't hesitate to contact me can see my email address there and i'll get back to you offline thank you very much for attending the seminar today this quick webinar and enjoy the rest of program today I consider you've got a fantastic program I know Lori's there I know that there's a bunch of people event and viv who her friends are presenting this afternoon have a great time of some sort and thanks for choosing the sermon coming along and hanging out for a while appreciate it good luck thanks doc appreciate the applause mate I can see that there's a message that's being sent from our team over in Western Australia to please login session then login to the next one so do make sure you log in to the next one get yourself settled you might even want to do that before you grab your morning tea just to make sure you all settle them organized they're not that I don't love you but I'm just passing on the message have you had found hope you've enjoyed the session guys look forward any feedback you going to provide me authorised by the government of western australia perth