• 1.What are ROPOTs?

    The ROPOTs (Revision, Opinion Poll and Testing) contain questions and allow students to actively answer. The system typically automatically stores and evaluates the answers.

    The preparation of the ROPOT consists of two steps - applications:

    1. Question Sets – what the ROPOT asks, the questions to be asked
    2. ROPOT Descriptions – who is allowed to take the test, when and under what conditions, from which question sets the questions are to be used.

    The ROPOT can, for instance, be used for the following purposes:

    Exercises
    Many questions designed for students to work on outside the classroom (recapitulation, drill, checking understanding of the material, ...). Students can open the practice test at any time and view the correct results after submitting it.
    PC-based test
    A clicker exam that students take in the computer classroom. The test is typically timed and the results are recorded in a notebook (the ability to generate a grade) without displaying the correct answers to the students.
    PC-based test demo
    The mode is used to easily create a sample test on which students can experience what a live PC-based test looks like. It is advisable to include it during the semester with sufficient distance from the actual testing. The results are not saved.
    Text (accompanied by other materials) or opinion poll
    Unscored questions with some accompanying texts – shorter interactive teaching materials (with checking of understanding of the text), surveys, questionnaires. The order of questions and answers is not mixed.
    Scannable test (multiple choice)
    Creating a printable test and then completing it on paper. The results are entered into a notebook after scanning the submitted paper. The scans are also stored in the student's Retrieval Box for review. Please note: the contents of the short answer sheet are entered in full, including the assignment, when uploading to the student's retrieval box.
    Scannable handwritten text and scores
    A very specific mode – the printed assignment with a free space is filled in manually by the student and the teacher manually corrects and enters the points. After scanning, the number of points is entered into a notebook and the corrected paper is available in the Retrieval Box.

  • 2.How do the ROPOTs usually work?

    First, you need to create a question set and then use the ROPOT description to define the behavior of the ROPOT (when the student can answer, whether they can see the correct answers, etc.). Only the ROPOT description will allow students to answer the questions, a question set alone is not enough.

    After creating the ROPOT, you can see how students will see the test. Via

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT
    enter the Administering ROPOT page and click on "answer questions"under the name of the ROPOT. From the same page, you can also access the students' answers, this time via the "responses provided" link.

  • 3.How will students see the ROPOT?
    If you want to try how students will see the ROPOT, try to practice answering it using
    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Answer questions (under the appropriate ROPOT description) or Fill in a ROPOT form (among the links at the bottom of the page)

    After submitting the test, you can view how you completed it by clicking on the "view" link. Please note that the link will only appear if you have enabled access to the view in the ROPOT description. This also applies to other settings, such as being able to answer the same form repeatedly or setting up new questions. If you have enabled the answer display, you will see the correct and incorrect answers marked in green and red, the correct solution listed in green, and the number of points scored for each question, if applicable.

  • 4.Where can I find responses provided by the students?
    Student answers can be accessed via Responses application:
    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT responses provided (under the appropriate answer sheet) or Responses (among the links at the bottom of the page)

    The Answers application displays all responses and person answering operations for the selected ROPOT. Students' answers can also be evaluated here (with points or verbal comments).

    On the page listing the respondents and their responses you can find all the information about who worked with the ROPOT, when and how. A list of respondents is available, which can be restricted and sorted as required, and batch operations can be performed on the list of respondents and their responses.

    1 For each ROPOT you can view the students' answers.

  • 5.What is the Answers application for and how do I navigate it?

    The Answers application records all the passes and operations during the answering process of all the persons recorded for a particular ROPOT, and displays the students' answers in the course in priority. The application can be launched via:

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT responses provided (under the appropriate answer sheet) or Responses (among the links at the bottom of the page)

    For the course teacher, the application allows to filter these ROPOT sessions using the options given at the top of the page, to delete sessions, to renew sessions, to force the submission of a pending sessions and last but not least to view the student's answers after submission or at different stages of filling in the ROPOT.

    In addition, the application allows you to manually rate the student's answers with points or verbal comments. Answers can also be exported or checked for plagiarism (see Help Are the answers in the ROPOTs also checked?).

    1 The instructor can choose to see only records of a limited group of students (e.g. his/her seminar group, etc.), or all records registered for the selected answer sheet will be displayed.

    2 Limit the list by type of records (e.g. all records, matching specified by the teacher, unassigned assignments, application numbers, etc.).

    3 Order the records and display additional information (e.g. about the manual assessment entered).

    4 Setting of batch operations (only those operations that can be performed on the ROPOT are always displayed).

    5 Under the assembly key icon, a menu of options for the pass will be displayed on that row (options vary for the whole record, the whole pass, just a specific operation).

    6 Attention to a work in progress pass and the option to end it, for all responders or individually.

    7 Warning of a mismatch in the number of operations performed, a passage reopened or a passage not yet answered.

    8 Date and time of the last listed operation, typically a submission, also a link to view responses/enter manual evaluation if set.

    9 List of matching operations in the sessionas; clicking on the date and time of the operation will display a tour of responses at the time of that operation.

    The display of options in the Answers app varies slightly based on, among other things, the mode of the answerer, its settings, or whether the answerer is allowed to have more than one pass. For individual records, sessions or operations, only those options that are relevant at the time, i.e. can be performed, are offered.

    Note

    The application works with the selection of students that the teacher has chosen when entering the Teacher agenda (active students of the course or perhaps just one seminar group). If the teacher needs to see all records for a given ROPOT, he/she must select "Display: All records". Then he/she will also see test passes of other teachers of the course or unassigned scan assignments.

    Tip: Terminology of the page with responses provided by students

    ROPOT administrator
    This is the person who sets up the ROPOT and performs other operations on it. Typically, this is the course teacher or a person authorized by the course teacher with access to the Teacher's Notebook. Anyone can be the administrator of a non-course ROPOT.
    The Record
    By a record is meant a user who responds a ROPOT (a respondent, typically student) or a compiled test sheet not linked any to student yet.
    Session
    The user creates the session by clicking on the "Launch a new ROPOT application" button, the system creates the assignment and starts the test. For each session, the date, time, and all operations made during a session are recorded.
    Operations
    The operation means opening, saving, submitting, viewing by respondent and changing the marking of right/wrong answers in the evaluation section by teacher. The system records all operations that are performed on the ROPOT session.
    Session in progress
    If a respondent launches the ROPOT, fills in at least one answer and saves it using “Save and continue” button, and does not use the "Submit" button, this session is marked as a session in progress. It is desirable that the sessions do not remain in progress, as only after submission will the test be evaluated (and the result written in the notebook, if required). A turquoise icon with an exclamation mark indicates a session in progress. An in-progress session can be ended either by the respondent submitting the test or by the teacher changing the save to submit in the session (for a tool to end a work-in-progress session, see the handling key icon – i. e. “Edit session” button).
    Mismatch in number of started sessions, session reopened, session still unanswered
    This is supplementary information, especially for cases where a student reports difficulty working with the answer key. They are notifications of a non-standard number or order of some operations. Mismatch in the number of started sessions highlights situations where there has been a mismatch in the number of times the ROPOT has been opened and submitted or vice versa. Re-opened session highlights a situation where the respondent has already submitted their answers at least once in the sessione, but then returned to the test again by clicking on 'Re-answer' and has not yet made any changes to their answers since then. For the passage with no answers so far, the answerer has made a new assignment but has not filled in any answers.
    Opened
    The date and time of launching the ROPOT session by respondent is recorded accordingly. For a compiled test sheet, it indicates the date and time the compiled test sheet was created (typically a compiled test sheet for scannable exam).
    Saved
    It records the date and time when the respondent used the "Save and Continue" button or when the continuous save occurred automatically.
    Submitted
    The date and time when the respondent clicked on the "Submit" button and the ROPOT session was evaluated, or when the session was automatically submitted at the end of the time limit for taking the test, is recorded
    Viewed
    The date and time at which the respondent viewed their answers is recorded. The ability to view responses and possibly see which ones are correct is set by the ROPOT administrator.
    Correction
    Record the date and time when the teacher made a change of the marking of right/wrong answers in the evaluation section of the answers (for at least one question, the teacher changed which answer was correct and the points were recalculated).
    Last important operation
    It is either opened, saved or submitted. It is marked with a black horizontal arrow in the list of operations next to the session.

  • 6.Where are the student answers from the scannable answer sheets?
    In the application
    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Responses provided (under the appropriate ROPOT description) or Responses (among the links at the bottom of the page)

    also find the responses of students who wrote the tests on scannable answer sheets. In addition, each student's test sheet number information is included. If you also need to see test sheets that could not be linked to a specific student, select "View: All Records".

    1 Responses from students who wrote the exam with scannable answer sheets, test sheet number is also given.

    2 Unlinked scannable test sheets.

    If students have handwritten a paper on a scannable answer sheet and after correcting it they want to discuss the marking of their paper with you, for example, you can view their paper using the application

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Browse answer sheets

    Responses provided by student are automatically removed five years after the session have been launched.

    1 The file with the removed responses in the file manager.

  • 7.Can I monitor student activity during the test?

    In the case of tests taken in computer classrooms in secure examination accounts without general internet access, the teacher can subsequently see a listing of other student activity in IS MU while the ROPOT session is being taken. This measure will make it possible in this type of examination to determine whether the student has been concentrating only on his/her ROPOT session or has been searching for information with the help of IS MU. The teacher can then evaluate this information.

    Note

    This function is not suitable for testing where the computer does not have Internet access restriction outside the IS MU

    In the description of the ROPOT, enter the range of IP addresses of the computers from which the test can be taken in the column "On which computers should the students be allowed to work with the ROPOT application?" (see the question What should I know if I want to organize a PC-based test for my students?):

    1 In this way, you can restrict the ROPOT to computer classrooms at the faculty.

    Subsequently, the teacher will have a listing of other student activities in the IS MU application after the test is submitted:

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Activities during test (at the bottom of page)
    Tip

    Have a faculty e-technician explain how to use the activity list and what each item means. This is a listing of operations that may not be well understood by the average user.

    Before the ROPOT session is launched, the student will be notified that his/her activity in the MU IS will be monitored during the test.

    1 Upozornění monitorování během testu.

  • 8.How do I find out the difficulty of the questions in the ROPOTs?

    Using the Difficulty level application, you can get a summary of the answers to each question in the ROPOT and see which questions are most difficult for students. You can find the application via

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Difficulty level (among the links at the bottom of the page)

    1 Each question has a difficulty coefficient.

    A table will be displayed showing the so-called difficulty coefficient. The difficulty factor is the ratio of correct answers to all answers (including unanswered questions). The lower the number, the more students made mistakes.

    You can also sort the questions by how they are placed in the set. The calculation of the coefficient may take into account the scoring of the ROPOT. For example, in the case of tests with negative scores for wrong answers, multiple-choice questions will be more comparable.

    You can also view the identity of the respondents and see how the selected students answered each question.

    1 Set the order of the questions in Difficulty level.

    2 Change if you need to take the ROPOT scoring into account when calculating the difficulty factor.

    At first glance, you can see the distribution of students' answers to the question. The prevalence of wrong answers may be an impulse to revise the wording of the question, or it may suggest that the material needs to be discussed more with students.

    1 Graph of the distribution of student responses.

    If the wrong option hasn't fooled anyone, perhaps it is unnecessary in the question or another one can be devised. This is a so-called non-functional distractor.

    1 Non-functioning distractors are highlighted in the Difficulty level application.

  • 9.I would need the student to launch the ROPOT and take the test again

    Sometimes it may happen that a student's connection breaks down while answering (e.g. when answering from home). You may also want to change the assignment and ask students to retake the test. In this case, you must first cancel the students' answers via

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT remove answers (under the relevant ROPOT) or Remove answers (among the links at the bottom of the page)

    You can cancel all responses from all persons or only the responses of an individual. You can cancel responses especially if you have set "no" or "Yes, they should, but it is always the same form (same questions) that should be offered to them." in the section dedicated to repetitive work with the ROPOT in the description of the ROPOT form. If it is a practice ROPOT with the setting "Yes, they should and some other questions should be offered to them next time they work with the ROPOT application.", the student simply launches the ROPOT creating a new session and the problem is solved.

    Cancelled answers are not definitively lost. You can restore them using

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT restore (under the appropriate ROPOT) or Restore discarded answers (among the links at the bottom of the page)

    Also remind students to use the "Save and continue" button. In the event of a power outage or disconnection, it is then possible to return to a partially completed test and complete it.

  • 10.I'm trying to work with a ROPOT, but my questions are not updating!
    After saving the ROPOT description, use the application
    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Fill in a ROPOT form
    fill in the form and submit it for evaluation. This is also how the student works with the ROPOT. Depending on what you have entered in the description, you can answer repeatedly or once, and you can have the same form over and over or new questions each time. A single launching of a blank form (selecting questions and assembling them into a page) is called a ROPOT session. In the application
    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Responses
    you can see who was working with the ROPOT.

    If the ROPOT description is set to "Should students be allowed to access this ROPOT application repeatedly? Yes, they should, but it is always the same form (same questions) that should be offered to them." you can still see the original session when you select "Work with the question form again" (in the ROPOT application).

    Note

    If you are changing a question set (editing text, adding a question, ...) and want to see the updated ROPOT, delete your original sessions using the

    The Information system Teacher [course selection] (ROPOTs and Quizzes) Work with ROPOT Remove answers
    If the ROPOT description is set to " Should students be allowed to access this ROPOT application repeatedly? Yes, they should and some other questions should be offered to them next time they work with the ROPOT application." you don't have to cancel your answers when trying the behaviour of the ROPOT, you can already create new sessions with the current questions.
  • 11.What should I know if I want to organize a PC-based test for my students?

    The agenda can be used for testing in the computer classroom. Students fill in a form in the IS, which itself corrects the exam. If the test includes free-form answers (which the system cannot correct automatically), the teacher will correct them manually later. The test is not accessible before the start of the exam.

    You can limit the time for taking the test, ither by the total number of minutes or by setting the day and hour from-to which the ROPOT can be worked with, or a combination of both (see above).

    If you limit the time for working with the ROPOT, the answers will be automatically submitted after the time limit expires. Therefore, the answers of students who did not save the test using the "Submit" button are not lost.

    Tip

    If you want to use the ROPOT for the real exam for grades, use the services of an e-technician – he/she will advise and check that everything is set up correctly.

    Organization of ROPOTs for multiple examination dates
    Make these decisions:
    Do I want to use one assignment for multiple examination dates?
    Do I want the student to not be able to view the assignment questions in any way after submitting the test?
    Depending on the level of "uniqueness" you require, you need to create as many ROPOTs as you need. The usual procedures are:
    • Each examination date has a unique assignment stored in a separate question set, the test questions are mixed (each student sees them in a different order)
    • For example, there are three different question sets, each set to be used on multiple examination dates.
    • There is only one assignment = question set.

    How many ROPOTs:
    Access to a single ROPOT can be "given and taken" over time. It can be made accesible on Mondays 8.00-9.00, then 14.00-15.00, etc., as the examination dates are organized. A student who has already taken the test cannot change the answers, but can look at the wording of the questions should he/she reopen the ROPOT when the next examination date is in progress. This can be avoided if you restrict access to the ROPOT to a specific part of the computer network (the classroom – LVT department will help), so that it is not freely accessible from the internet. If you cannot use this restriction and do not want students to be able to return to the assignment, create a separate ROPOT description for each examination date.

    Security mechanisms
    Find out from the technical support of the computer room the range of addresses of the computer network of the classroom (the so-called IP addresses) and enter them in the description of the ROPOT– the section "On which computers should the students be allowed to work with the ROPOT application?". The student can also give you the address of the computer individually, it can be found under

    Information system System Remote client IP address

    If you don't want or can't find out the IP addresses, you can do the following:

    • Use the regular examination dates application to divide students into examination dates, set up "log in" and "log out" dates well before the exam date so that someone can't log in at the last minute and open the test (view the test questions).
    • In the description of the ROPOT, under "Rights and time group", specify that only those with a reservation on a specific examination date can open it.
    • At the beginning of the exam, check attendance and remove those students who are absent from the examination date reservation (so that they do not open the ROPOT from the internet during the exam).

    You can also use other security mechanisms:

    • You can specify in the ROPOT description that a wide coloured column should appear on the left side of the screen when the ROPOT is launched.

      1 A coloured column in the ROPOT as part of the security measures.

      It allows you to remotely check that everyone is working with the correct ROPOT only. You can choose the colour of the column to distinguish e.g. individual test dates.

    • If you have set up the display of the left column (see the previous paragraph), the identity of the respondent, i.e. the name, učo and photo of the person logged in, will also be displayed. This will make it easier to check the identity of the respondent.
    • You can contact the faculty CIT to ask if it would be possible to disable access to other sites than is.muni.cz.
    What else is good to know...
    The student cannot unknowingly open the ROPOT twice (e.g. by double-clicking). If such a situation occurs, MU IS will ask the student whether he/she really wants to open the ROPOT a second time. The same question will be asked if the student wants to open the unsaved test in two browser windows or panels. Whether he/she will be able to do this depends on the setting of the parameters in the ROPOT description, but the ROPOT cannot be reopened and the answers cannot be continued/changed if the setting is "no (once you open the ROPOT, you cannot reopen the ROPOT sometime later and change the answers)"..

    Students have a "Save and continue" button to prevent inconveniences caused by power outages, etc. If you set in the ROPOT description for the test to have multiple pages, “save and continue” is done automatically when a respondent moves between pages. It also occurs when a respondent presses the "Enter" key. However, only the final submission, is the decisive moment for the evaluation of the test and the allocation of points..

    The system records all operations that have been performed (time of launching the ROPOT, computer address, answers chosen, time of submission, viewing the answers, etc.). In the event of problems or suspected malpractice, these data can be found.

    If a student accidentally submits a session for evaluation, they typically cannot return to the test. A possible solution is to remove his/hers answers with the application

    Information system Teacher [course selection] Work with ROPOT Remove answers

    and let him/her launch the ROPOT all over again.

    If you are new to testing or are unsure of your ROPOT setup, feel free to contact your e-technician. We will review the ROPOT description and recommend the best combination of ROPOT parameters for your needs. You can avoid unpleasant situations where the combination of inappropriate parameters would make the ROPOT not behave as you want.

  • 12.I want to process the collected answers myself – export answers from the ROPOT
    Student responses to a particular ROPOT can be exported to different formats and further processed freely. Use the application in the Teacher's Notebook
    Information System Teacher [course selection] Work with ROPOT Export answers (among the links at the bottom of the page)

    Select the ROPOT from which you want to export the answers. In the application, you have the possibility to modify the export properties (form of exported questions and options, answers, sessions, etc.), select the exported file format and encoding. The exported answers can be output to the screen or printed, this option is mainly used to check the exported data. For further processing of the answers, use the export to a text file or formats designed for processing in Excel.

  • 13.I want to process the collected answers myself – output to XML
    You can view the students' answers in XML format, which is suitable for further processing by a programmer. You can retrieve them using
    Information System Teacher [course selection] Work with ROPOT XML (among the links at the bottom of the page)
    Download them to your computer and give them to the programmer.

    Student responses in the answer sheet can also be exported to a pdf file and then printed. It can only export ROPOTs where questions of type :a (open answer), :r (select one answer), :c (select multiple correct answers) are used.

    It is available under the link

    Information System Teacher [course selection] Work with ROPOT PDF

    The exported pdf contains a list of students who have completed the ROPOT. Student responses always start on a new page. The pdf can be used to archive the answers, for example, for state final exams or admissions.

  • 14.What is the meaning of the a_texty folder in the ROPOTs folder in the Study Materials?
    The a_texty folder is created if you have ROPOTs with free-form answers. Student answers are stored there in text format. IS MU needs these files to search for plagiarism, but they are not important for a normal user.

  • 15.Can I make the ROPOT available to persons who do not have access to the IS MU?

    Yes, you can. The ROPOT can also be launched in unauthenticated mode, i.e. without logging into the IS MU. Just add the right "anyone on the Internet" in the section "Rights and time group" when editing the description of the ROPOT. Anyone can then launch the ROPOT via the unauthenticated link to the *.qref file.

    Note

    They must enter a "world address" starting with „https://is.muni.cz/“.

    With unauthenticated access, the identity of the respondent cannot be uniquely determined because individual accesses are identified only by an access number. This number, which is displayed in the list of answers instead of the name and username, is stored in the browser by means of cookies and allows, for example, to retake the test from the same computer and account and to view the results of the previous session. For unauthenticated access it is therefore necessary to have cookies enabled in the browser. Access via an unauthenticated link from another browser/computer means a completely new launch of the ROPOT.

    Points from unauthenticated accesses cannot be recorded in the notebook.

    ROPOTs with non-authenticated access may be useful for various surveys and polls (e.g. during open days).

  • 16.How do I find out the results of an unauthenticated ROPOT?
    The statistics of the scores and the number of completed tests can be found in the usual way by selecting
    Information System Teacher [course selection] Work with ROPOT Responses
    or through the Difficulty level if it is prepared within the course (which is not necessary, it can be placed outside the Study Materials, e.g. in the Document Server).

  • 17.Can the ROPOTs be used for admissions?
    Yes. In the description of the ROPOT, you can assign the right to work with the ROPOT using Rights and time group setting to applicants for study (i.e. persons who have submitted an application for study) or to sit entrance examination, where you specify a specific date. These persons will be identified by an application number.

  • 18.How do I get a simple list of respondents with scores without using notebooks?
    The IS MU allows you to easily obtain a list of persons (who have passed the test) with the number of points achieved and the time of completing the test using the "simple export" function. The function can be accessed using
    Information System Teacher [course selection] Work with ROPOT Responses Print and Export Simple export
    Here you can choose whether you just want to print the list to the screen or download it in Excel and Word format. The list contains all the people who have worked with the ROPOT, including the respondents authenticated via application number and records of unauthenticated accesses (instead of the name, the record is indicated by the access number).

    Simple export is useful for obtaining scores from unauthenticated accesses to the ROPOT, or when using the ROPOT outside of a specific course.

  • 19.What is the purpose of exporting :r and :c questions for Drill application?
    Use the "Export Questions for Drill" feature if you want to allow students to practice the material using Drill application. The export can be found in the application:

    Information System Teacher [course selection] Work with ROPOT Export Questions for Drill

    Use the form provided to find the question set you want to export and confirm with the "Use" button.

    The export application allows you to export the questions including all options in CSV format, which you then use as a data file for importing into the drill. Exporting for drill is only suitable for :r and :c questions where students do not need to know the exact answer but are able to select it from the options provided.

    We recommend that you use the drill export only for questions that contain some factual knowledge. You can learn more about drill application in the Help

    Information System Help Drill – spaced repetition

    and in the question: How do I import data from the answer sheet into the drill?

  • 20.How do I transfer answer sheets to the current semester?
    For the transfer of ROPOTs, as well as other materials in the course, there is an application for copying materials:

    Information System Teacher [course selection] Sharing and copying study materials Copy Study Materials

    Here, select the course and semester from which you want to copy the ROPOTs and any other files and click on "Copy".

    In addition to actually copying the materials, this application also sets access rights and access rights in the ROPOTs for the target semester.


Provided you have failed to find the information you were searching for, you can contact us at etech(zavináč/atsign)fi(tečka/dot)muni(tečka/dot)cz.