10:06:39 If you ask a question in the chat, we will probably politely request that you Ask it again in the Q&A.
10:06:49 Thanks Chris. You can find the Q&A button along the bottom. For some people it may be in your more menu with the 3 dots.
10:07:00 That's where it is for me right now. So, please take a moment to find that Q&A just in case you're going to need it.
10:07:08 And let's move to the next slide.
10:07:12 At this point, I believe I will step aside and hand the mic to Andrea Lockard.
10:07:18 Thanks, Ben. Good morning, everybody. Happy Wednesday. I'm welcome.
10:07:23 It's great to be in space with you today. Andrea Locker, director of assessment and student reporting.
10:07:28 In our last DTC webinar back in February, we are I had shared just a little bit about what we knew about.
10:07:35 What I wanted to give an update today with is there's actually a website that was launched by ODE.
10:07:45 Today with is there's actually a website that was launched by ODE. Thank you so much.
10:07:49 And so if you're wondering about I think they've tried to make it kind of a 1 stop shop.
10:07:55 So included it's got ODEs guiding statement, any any actions that have a median impact on our work, some of the latest updates, for example, like the, the communication from our own state attorney general.
10:08:09 So if you're curious or you're in need of resources, that's a really great place to begin with.
10:08:16 And that's an update that we had since last month. So I wanted to make sure it's kind of, and that's an update that we had, since last month.
10:08:24 So I wanted to make sure it's kind of late breaking and actually, launched last week. So I wanted to make sure you all have access to that. Thanks so much.
10:08:26 I'm going
10:08:28 Thanks Sandria. Our next slide has reminders and updates. We'll start with updates.
10:08:36 Here you can see that we will publish after the webinar, we'll publish a recording. And or excuse me a recording will exist you can contact Chris Plantner to Get a hold of it.
10:08:50 We have a reminder here that ESD partners are the people to contact if you wish to upload remote test settings into TIE.
10:09:00 And then this 3rd item I will be speaking on behalf of our colleague Sodie Fern who is otherwise engaged today.
10:09:07 The early learning transition check-in fall pilot. Schools and districts have been identified. So if you are one of those participants in the pilot, then you can expect professional learning materials by May 1, st 2025.
10:09:25 If you have questions about anything related to the early learning transition check-in. Please contact our K 2 balanced assessment specialist, So D Fern.
10:09:34 And I think we have another update slide. Oh, we have reminders. Here you will see a copy of the A and A update article about.
10:09:49 Spring Summit of test windows or spring assessment test windows. Opening and we have we're getting into the thick of assessments season now so you can see multiple tests are opening and Please do consult the.
10:10:09 Test schedule found in Appendix A of the TAM or posted independently on the assessment administration page for a global view of which instruments open.
10:10:21 And close on which dates. Next slide, please.
10:10:28 Here's another reminder about as a test administration monitoring. And I believe I'm going to hand the microphone to Mariela for this one.
10:10:41 Thank you, Ben. Good morning, everyone. Maria, Saas, science assessment specialists. It's great to see you all today.
10:10:50 Thank you for spending a little bit of your morning with us. I'm doing a little reminder of we are running, some QA sessions if you need them, to talk about or address any questions.
10:11:02 You have, especially for districts that are in cycle this year on 2025 to be a monitor. We are, I put in the link the zoom, link so if you would like to join us we have another session on March 21st from 1230 to 1 30 and i will pass it to Ben and if you have questions send us an email as well
10:11:32 Thanks, Marilla. The next slide has to do with test improprieties. Just a real quick snapshot.
10:11:41 We're seeing We did see test improprieties increased significantly in 2,024, spring, 2,024 over 2,023 and it looks like we are on track to meet that same rate.
10:11:55 This year? And more impropriety reports means often more investigation needed by ODE. So. We urge you to.
10:12:11 Please check your accessibility supports before opening a test. To prevent any problems before they start. And if a problem arises Please investigate to make sure you understand what is happening so that you can provide as complete a report as possible.
10:12:32 And help us make a decision about this students. Test record. In some Maybe even many impropriety reports that you receive.
10:12:44 There's a little section at the top that may have a custom message for you as the DTC.
10:12:47 My recollection is that this isn't bolded or anything, it just appears in the middle of other stock text and could be easy to overlook.
10:12:56 So I'm gonna recommend highly that you just Double check that head of the impropriety report to see if there is a personalized message for you as the DTC.
10:13:09 These messages could include information as to, for example, why an outcome was approved. Or needed district action.
10:13:19 This next slide is a repeat from last year It's an illustration of what kind of report helps ODE make a decision about the students test record and What kind of report may need more investigation from ODE.
10:13:39 So in general, more information is better than less information. And it is very helpful if you can explicitly confirm.
10:13:51 What your investigation supports. Now, know some DTCs may be looking at the left column here and thinking I don't have time to write a novel for test impropriety that comes in, I need to find a balance between Enough information but also doing this in an efficient way.
10:14:15 So I get that. I'm not asking that every test impropriety be a 2 paragraph. Short story.
10:14:24 But It is very important. To convey enough information so that ODE knows was test validity or test security impacted?
10:14:35 And if you have recommended an outcome, which you will because it's required. So per your recommended outcome, What does your investigation support?
10:14:48 And if you can answer or indicate the the response to those questions in the TAM. That is going to be very helpful for us to feel sure that the DTC has investigated.
10:15:05 And we won't have to worry that maybe a statement from a TA or SDC was copied and pasted without being verified.
10:15:14 So. We will continue to reach out when we need more information or if we perhaps see an opportunity that might lead to a better outcome for a student.
10:15:27 But please do if as you are able, please do help us with How are investigation by supplying the most complete information that you can.
10:15:39 Next slide, please.
10:15:42 At this point, I'm going to ask our regional ESD partner, Amy Rockwell, to take the stage momentarily.
10:15:51 Thanks, Ben. We wanted to make sure everyone was aware that in February, ODE hosted a training that you might want to take a look at if you haven't had an opportunity to do that yet.
10:16:05 In that training. We covered for example a brewa and how to edit test records in a and it also covered secure assessment reports, so accessing the individual student reports.
10:16:19 And then also one of the other important topics was accountability warehouse extract. So we encourage you to take a look at that training if you haven't been able to do so yet.
10:16:29 We also wanted to give an update on scores and when those will be available. So the English language arts and math scores are going to be released next week.
10:16:40 So starting on March, the 18, th those will be available in the ODE applications. And you can expect to receive scores for El and math about 2 weeks after a student has completed both the the cat and PT portions of the test.
10:16:55 For science, those scores are already available in AREA and those have a much faster turnaround time.
10:17:01 You can expect about one to 2 days before those scores are available. And then for Those scores are released in batches.
10:17:10 So any test that was completed during the month of January will be available next week on the 17.th So just a reminder with all the ODE applications, if you don't have access to those, your district security administrator is so you'll contact.
10:17:25 And that person can set you up with access to those applications. And then I also wanted to remind you that all of these states are available in the assessment account.
10:17:36 Accountability checklist. So make sure you continue to review that throughout the year for these states.
10:17:50 Thank you, Amy. I believe our next slide is going to be voiced by our colleague Andy Barley.
10:17:57 Yes, thank you, Ben. Good morning, everyone. Andy Byerly, Math Assessment Specialist at ODE.
10:18:02 Huge thank you to the 37 DTCs who responded to our survey that we shared in last month's webinar and and through the the DTC lists serve.
10:18:16 I wanted to bring some highlights from what we learned from you and I will say that we had a very good representation geographically of Oregon.
10:18:27 So we had districts of all sizes up the I 5 corridor as well as quite a few in eastern Oregon and on the coast.
10:18:38 So it's a good sampling. We had about 20% of DTCs respond. The 37 who responded 32 of those districts utilize STCs and 31 of those 32 districts utilized the DTC to train those STCs.
10:18:59 So that's good confirmation for something that that we've been curious about. Most DT most STC training occurs in December and January.
10:19:11 And in 23 of those 32 districts that use STCs all of those folks are trained together.
10:19:19 And you can see a little bit about how that training happens in the charts below. Most districts are using the ODE published training modules in their published format.
10:19:39 Several will use district specific content added, things such as local schedules, calling out specific parts of the TAM or the OAM.
10:19:49 And so we're grateful to understand a bit more of how the training modules are used. In terms of TA training in in about half of districts DTCs themselves train TAs.
10:20:03 So even in some districts that utilize STCs, it is the DTC who's doing TA training.
10:20:11 In the balance of districts, STCs are training TAs. And most of the . A.
10:20:18 Training occurs in February the bar graph in the lower right, shows responses, to the question, overall, how useful are the ODE provided OSS training modules?
10:20:35 And you can see that there's quite a range there, but the mean of those responses was just over 7.
10:20:42 So this gives us some really useful information. And we are hosting next week. 2 focus groups with DTCs who wanted to give us even more information.
10:20:55 So we're very much excited for those. One is Monday afternoon, the other one is Wednesday morning.
10:21:01 We've got some great things planned in terms of some round tables, doing a deeper dive into, doing a deeper dive into the full set of some round tables, doing a deeper dive into the full set of data.
10:21:12 And then we've also pulled out some themes from your responses in terms of action steps to improve, potentially improve training.
10:21:19 On the next slide, I do want to just caution folks that one of the beautiful parts of Oregon is that our districts have a lot of freedom to meet the needs of your educators and to meet the needs of your students.
10:21:36 And of course one of the shadow sides of that is that there's no one size fits all approach.
10:21:41 And this question here gives one, I give some idea of that. So this question was, how is TA training conducted in your district?
10:21:52 And the blue part of that pie graph shows that all TAs receive the same training. There's no differentiation across grade bands or content areas or whether someone is a new TA, everybody gets the same training.
10:22:08 And you can see different variations on that moving down. So orange indicates districts that in which new TAs receive a different training than than returning TAs.
10:22:20 The green shows TAs that receive training based on the specific tests they administer. And the red wedge of the pie shows that TA training is conducted by grade band.
10:22:36 And then we had some districts that that chose other and specified even even a different approach. So again, we're trying to make sense of all the information that you gave us, knowing that there's a variety of ways that that you all are using those training modules.
10:22:54 So we'll continue to bring up updates back but again just tremendous gratitude for those who took the time to respond to our input form.
10:23:03 Thank you.
10:23:09 Thank you, Andy. I believe for the next slide, will be welcome Tony Bertram.
10:23:16 Thanks, Ben. Good morning, everybody. I'm Tony Bertrand. I am the ELA and Social Science Assessment Specialist with ODE.
10:23:23 We want to tell you about a new resource that we just published and it is available through our partnership with Southern Oregon ESD.
10:23:30 We get many requests for OSS interim assessment trainings. And so what we've tried to do is consolidate ELA, math and science into one Canvas course, that, educators across the state can use.
10:23:44 It is free, it's freely available, to Oregon educators as part of our partnership with Southern Oregon ESD.
10:23:53 The course implementing the OSS interim assessment consists of 5 1-hour modules, delivered through their Canvas course.
10:24:01 And so we do have a flyer, which I believe just got posted. So the flyer is posted to give you a little bit more information on that course that's available to educators.
10:24:10 And again, no cost to organ educators. We've designed it to choose your own adventure because we know that the needs for an ELA educator may be different than a.
10:24:20 Educator, which is then different than a science educator. So we tried to be very universal and provide a ton of flexibility in the course modules, that are very universal and provide a ton of flexibility in the course modules that are available for you.
10:24:31 On the next slide, some of the high level overviews of what participants will go through as you all know, the OSS interim assessment is just one component.
10:24:41 Of the statewide assessment system as part of our balanced assessment approach. So it includes interim assessments as well as formative assessment practices to provide that understanding and high overview of what a balanced assessment is.
10:24:53 We focus in on gaining a deeper understanding of the complexity of how to best assess organs academic content standards and again in all 3 content areas.
10:25:04 The 3rd session really focuses on selecting the appropriate interim assessment blocks within, existing district curriculum maps or pacing guides.
10:25:15 Again, we wanted to create that flexibility for Oregon educators to most appropriately use. The interim assessments as part of their regular instruction as opposed to a break in instruction.
10:25:28 So that is covered in session 3. Accessing data is a big, thing that DTCs normally.
10:25:34 And so we tried to provide at least some of that background to take some of the work off of DTCs by providing examples within the modules.
10:25:43 And then last is how to build this as a sustainable and appropriate approach. And use and and how to best embed interim assessments within existing curriculum apps and pacing guides and we've received some feedback from some school districts that are doing some incredible work.
10:26:00 With that. In addition to the flyer, these are posted on our OSS interim assessment page under the professional development accordion.
10:26:09 We also have a ODE assessment professional development page that has summative interim formative many other professional development resources.
10:26:19 So they're also on the ODE assessment professional development webpage. And as always, please reach out.
10:26:24 To either myself, to Andy for mathematics or Mariela for science. We are very passionate about this.
10:26:31 We like working with DTCs and educators. And so we are here to support success. With the interim assessment system.
10:26:40 If you have any questions, please go ahead and put those in the QA question. catcher and we'll go ahead and try to address those otherwise please access that fire as a 1st step and then reach out to ODE if you have any additional questions.
10:26:56 Thank you so much for your time and I hope that this is a valuable tool to your district, to your schools, to your educators that you're supporting.
10:27:03 Thanks, Ben.
10:27:06 Thanks a lot, Tony. We'll be watching the Q&A in the chat for any comments.
10:27:11 Related to the interim assessment canvas course. The next slide I believe will be voiced by Audrey Lingley.
10:27:19 Good morning. My name is Audrey Lingley. I'm an assessment specialist here at ODE and my area focus is the administration of the seed survey.
10:27:29 I have a couple seed survey updates that I wanted to share with this group. One is that there is a new research brief that has been published using last year's seed data.
10:27:41 And the topic is post-graduation planning. I know marches CTE month, so this might be something that is of particular interest to.
10:27:51 Your career counselors and any CTE folks. Our next data use professional learning series session is going to be on April 4th to register for that and learn more about the series.
10:28:06 I recommend looking at the series flyer. The topic will be postgraduation planning.
10:28:14 We'll be focusing on How ODE used different data collections. To What, how ODEUs, see, survey data to contextualize.
10:28:24 And shed more light on other data collections. And then finally, I wanted to let this community know that ESD-level aggregations for the 2,023 2,024 seed data are now available.
10:28:42 If you would like those EST level aggregations. Please send an email, to the Seat Survey email account, which is in the chat and on the slide.
10:28:54 And we will get those aggregations out here. Thank you very much. I'll pass it back to Ben.
10:29:03 Thanks, Audrey. We just absolutely blazed through the content today. On the next slide, you'll see.
10:29:13 Questions, concerns and recommendations? If you Have those brewing. Please type them into the QA or if you feel they would be better voiced.
10:29:25 Via the audio channel, raise your hand. While we are waiting for people to formulate their questions, or type them into the QA, we'll go ahead and cover closing information in the last slide.
10:29:41 As always, this slide deck. And it's a company in Q&A document will be posted to the Assessment Administration Resources page.
10:29:51 And the ODE assessment team is. Standing by. Many hours a day, not 24, but lots.
10:30:01 To answer your questions. So please do contact us with any questions. You may have. And now I'm going to ask that we go back to the previous slide just in case there are questions brewing so We are looking at the chat.
10:30:20 We're looking at the Q&A document and We're scanning the participant list for any hands up.
10:30:27 If there are no Q&A chats or hands up. Then as as often in the past, we're going to take that to mean that we did an amazing job.
10:30:39 And that you are 100% informed but I see that someone is already already putting the lie to that claim.
10:30:46 Dana, I see your hand up.
10:30:48 That was my only goal was to put the lie to that claim. So thank you, Ben. And for, for recognizing that.
10:30:56 Back to the modules for, that was a joke. Back to the modules for the interim assessments.
10:31:02 Are those modules I see that they go like when you click on that register the registry link it goes to PD networks are those intended for individuals to be signing in or could it be something that you bring everybody together and you play up on the screen and are watching together.
10:31:23 I heard you say that some not all of the modules may be relevant to all the people, but could it be structured that way or must it be an individual login?
10:31:37 Dana, thanks for that question. It because there are PDUs connected as, as in the, flyer.
10:31:47 There are multiple pathways that you could choose. So if educators wanted to get the PDUs, they would have to log in, into their own accounts in order to get their own PDU, as well.
10:32:01 Because if you are a middle school teacher for instance, this is probably the best example. If you are in the area of English language arts and your participating in how to best select interims for your content area.
10:32:17 You wouldn't need to necessarily finish module 3.3. Or which is math specific or 3.4 which is science specific.
10:32:28 So that's the kind of flexibility. And so we have guidance when a educator 1st logs into the module that will talk about that guidance of which which subsections may be most appropriate.
10:32:42 As they're navigating through. Did that help to answer?
10:32:48 Okay.
10:32:47 It did. And if, if I'm getting too specific about any of this and we can bump into another, but if a person like me wanted them to see them, the teachers to see these and I wanted to say please complete these at your at your own time.
10:33:09 Is there a way for a person like me to be able to go back and see, oh yes, they did, they all of these are complete and this whole group has, done has done the modules.
10:33:21 There's nothing within the system. That allows that kind of supervisory overview. My recommendation for that would be to ask the educators to print off their PDU, PDF or to have some way of documenting their completion through their PDU credit that they receive by going through the module.
10:33:42 So I think that would probably be the best way. From an administrator. Point of view.
10:33:48 Excellent. Okay, thank you very much.
10:33:51 Others may have other ideas as well, but that would be probably a safe approach. If I was thinking creatively.
10:33:59 I'm actually gonna add voice to the question that. Megan's, Question was, does this, does this count in lieu of, the, you know, the training requirements.
10:34:15 This is a professional development resource to become familiar. The training requirements are still required as specified in the TAM and completion of training module.
10:34:22 9 is still required in order for the interim test group to be assigned to a TA educator.
10:34:28 So this is not an in lieu of this is a professional development resource, to build capacity and understanding of the OSS interim assessment system.
10:34:37 So Thank you for that. Question that was put in the catcher a while ago.
10:34:48 Thanks, Tony. We have. A question or 2. Come in at least one to me privately and one in the Q&A about sticking around and asking a specific question at the end of the webinar.
10:35:03 We on the ODE team are going to hang out and keep answering questions as long as the webinar is still running for those of you who are Staying on if if at some point the you decide these are not relevant to me, then you are welcome to move to your next engagement.
10:35:22 But we are going to stick around and answer questions as long as they come in. So thank you for your attendance.
10:35:29 Please stick around if this is useful to you and if not, have a great rest of your day.