Monday, 7 January 2013

The ILA (methodology)


Background

Finding a class to observe during their Inquiry learning Activity proved quite difficult (see post on Comparison to Kuhlthau’s ISP and also "What my ILA is all about"). Fortunately I did find an excellent school with a very experienced IL teacher and although the students’ ILA was not complete by the end of the university year, my lecturer gave permission for the late submission of my research project. This will be the first post in a sequence of posts describing how data was obtained and used to report the findings of this study.

Methodology

Data were collected using the School Library Impact Measure(SLIM) toolkit. This instrument was developed by Todd, Kuhlthau & Heinstrom in 2005 and was designed to measure changes in students’ levels of knowledge and information skills throughout an Information Learning Activity (ILA).
The details of the ILA as presented to the students can be found here. The aim of the study was to identify and assess which of several models of inquiry learning was used. Prior to the commencement of the ILA the teacher and I had a meeting to discuss the details and purpose of the ILA. I was told that it would continue for the duration of the fourth term, six weeks with three lessons per week. I was not able to attend all the lessons, but made sure I was there at least once a week. The teacher was informed that I would administer three questionnaires to the students. This happened at the beginning, middle and end of the unit. The teacher let the students know what would be happening before my arrival and kindly allowed me to address the students during my first visit. I informed them about the purpose of the study and assured them that their identity and that of the school and teacher would remain confidential at all times.  All students appeared interested and agreed to take part.

The first questionnaire was administered during their second lesson on the ILA. The second questionnaire was completed by students after the ILA had been running for 4 weeks. The third questionnaire was administered after a presentation evening during which students presented their results graphically and tangibly. They verbally explained and defended their findings to staff, parents, relatives and friends. Twenty four Year 9 female students from an independent school based in Brisbane took part in the study. Two students did not complete all the questionnaires due to absence however their responses were taken into account where appropriate. A random sample of 10 students' results were chosen for a more in-depth report. Approximately every second student was selected from an alphabetical list.

Data for the questions were coded and analysed according to the SLIM toolkit. Some of the literacy skills mentioned in the toolkit were not encountered in any of the students’ answers and were therefore not included in the analysis report. Excerpts of the students’ responses and the reasoning behind placing them within certain “literacy skill” categories have been explained for each of the students used in the sample. Details of the results of the data analysis and the interpretation of these results can be found in a later post.

References


Todd, R. J., Kuhlthau, C. C., & Heinstrom, J. E. (2005). School library impact measure (SLIM): A toolkit and handbook for tracking and assessing student learning outcomes of guided inquiry through the school library. Center for International Scholarship in School Libraries, Rutgers University.

The Students' Task



Some of the words and phrases used in the original have been changed to preserve anonymity. This is a copy of the original task as it was presented to the students. The original formatting has been removed.

ECOLOGICAL FOOTPRINT

 
1.
Gain an understanding of the ecological footprint concept. Go to the Ecological Footprint web site and complete the survey to estimate your ecological footprint. Explore the website to see how and where you can reduce your footprint.
2.
Identify one ‘footprint factor’ that is of interest to you on which to focus your inquiry (i.e. one factor that influences the size of your ecological footprint) and some ‘sustainability strategies’ (i.e. strategies that you, your family or local community could implement to reduce your ecological footprint).
3.
Construct a set of geographical questions to guide your inquiry and identify the research and primary data collection strategies you will use. Use this to construct a research proposal to show your teacher.
4.
Carry out research using your geographical questions to guide you. Ensure your research involves the use of both primary and secondary sources of evidence. As well as researching the ‘footprint factor’ you must identify a strategy that could be implemented (either by you and your family or more widely in the community) to reduce that ‘footprint factor’. As you carry out your research you must submit draft sections.
5.
Analyse and evaluate your results. Decide on how to present the data you have collected and decide on the strategy/solution you will present. Construct your annotated visual display (AVD) and exhibition materials for the presentation evening.

STEP ONE –GAIN AN UNDERSTANDING OF THE CONCEPT OF AN ECOLOGICAL FOOTPRINT AND COMPLETE THE SURVEY AT WWW.MYFOOTPRINT.ORG
This will involve working in class with your teacher who will lead you through a number of lessons introducing relevant ideas and concepts.
Some basic questions to consider.
1. What is meant by the term ecological footprint?
2. Read the FAQ section of the web site. What is meant by the following?
a) Carbon footprint
b) food footprint
c) housing footprint
d) goods and services footprint
3. How big is your footprint? How does it compare to the national and international average?
4. Compare and contrast your results with someone else in the class.
5.  What are some ways you could reduce your footprint?

STEP TWO –IDENTIFY AN AREA OF INTEREST THAT WILL BE THE FOCUS FOR YOUR INQUIRY
What does this involve?
You are required to select and focus your research on a particular ‘footprint factor’ relevant to you or your community.
How do I do this?
Consider the questions in the quiz. The ‘FAQ’ section of the myfootprint.org website has a useful explanation of the kinds of factors that influence your ecological footprint. See http://www.myfootprint.org/en/about_the_quiz/faq/
Select one ‘footprint factor’ for further investigation. Do some basic research about this ‘footprint factor’ to gain a basic understanding of how this factor impacts on a person’s ecological footprint and identify some strategies that are, or could be, used to reduce this ‘footprint factor’.
Here are some examples:
Example 1.
Mary notices in the ecological footprint survey that transport is a significant source of greenhouse emissions and that car use is one of the major contributors to this. She notices that the Ecological Footprints web site says that one way to reduce her transport footprint is to, "Walk, bike, or take public transport whenever possible." She does some research, including some ‘at home’ data collection on her family’s car use and finds out how many kilometres her family travels and how much petrol they are consuming. She then discovers that in some cities around the world (such as Seattle) the use of bicycles to travel to and from work occurs at a much higher rate than in Australia. She wonders what Australia is doing to encourage people to use bikes for commuting to and from work?
Example 2
Phoebe notices from the survey that where you obtain your food influences your ecological footprint. She does some research and discovers that most of her food is sourced outside Brisbane: some of it even comes from other countries. She sees that one of the solutions suggested on the Ecological Footprint web site is "Shop at your local farmer's market or natural foods store. Look for local, in-season foods that haven't travelled long distances to reach you." She is aware that farmers’ markets are held regularly in a nearby suburb and wonders whether these are successful and if more could be held in the city.

STEP THREE –REFINE THE AREA OF INTEREST FOR YOUR INQUIRY BY DEVELOPING A SET OF GEOGRAPHICAL QUESTIONS TO FOCUS YOUR GEOGRAPHICAL INQUIRY.
What does this involve?
To provide an initial direction for your inquiry (and to enable your teacher to evaluate your proposal) you must construct a set of “geographical” questions about the ‘footprint factor’ you have identified as your research focus. Your inquiry will focus on answering these questions.
How do I refine my research?
Time will be devoted in class to this process, stressing the importance of developing suitable open-ended as well as closed questions.
You refine your inquiry by developing a set of “geographical inquiry questions” about the ‘footprint factor’ you have identified as your focus. Geographers structure their inquiry around a particular set of questions that we refer to as “geographical questions”.
These “geographical questions” are:
What is it?(i.e. defining the issue/problem of study)
Where is it?(i.e. analysing where the issue/problem occurs)
Why is it like that? (i.e. analysing how and why the issue or problem occurs and why the particular patterns of occurrence exist)
What impact?(i.e. analysing the relationships between the problem or issue being studied and people and the environment –how they impact on each other)
How should it be managed?(i.e. what is the best way to solve the issue or reduce/control the problem?)

To refine your inquiry proposal apply these questions to your topic. As you work through the research process new questions will occur to you.
Here are some examples.

Example 1
After doing some very basic research Mary develops the following set of “geographical” questions to focus her research -What is a carbon footprint? What are greenhouse or carbon emissions and what are the main ways that transport creates emissions? Where in Australia are most transport-related greenhouse emissions created? How much petrol is consumed by driving me around? Can bikes reduce greenhouse emissions and my ecological footprint? What is the level of bike use in Brisbane/Australia and how does it compare to other cities/countries? Would my family use bikes more often? Why are bikes used less in Brisbane/Australia than in some other places? What are some ways to encourage bike use? What are other places/countries doing to encourage the use of bikes? What recommendations would I make to decision-makers such as the City Council or the State Government?
Example 2
Phoebe develops the following geographical questions to focus her research-
How does food get to the table? What types of emissions and in what quantities does food production create? What are’ food miles’? How many food miles would I be responsible for? What alternative strategies can be implemented to reduce the ‘travel time and distance’ and ‘eat local’? How could we encourage more ‘farmers’ markets’?


STEP THREE (CONTINUED) –IDENTIFY SUITABLE RESEARCH STRATEGIES YOU WILL USE TO GATHER RELEVANT INFORMATION ABOUT EACH SECTION OF YOUR INQUIRY.
What does this involve?
You need to indicate in your proposal how you will find the information you require to answer your inquiry questions. You must include primary data collection strategies as well as secondary research. There are number of primary research strategies you could use in this assessment task to gather primary data such as:
taking and using photographs
collecting and analysing statistics
conducting interviews
constructing and conducting a questionnaire or survey or an audit
direct observation
A ‘geographer’s toolkit’ is available in Masterfile.

STEP FOUR –CONDUCT YOUR INQUIRY GATHERING RELEVANT PRIMARY AND SECONDARY SOURCES OF INFORMATION. MAINTAIN A RECORD OF RESEARCH. DRAFT EACH SECTION OF YOUR INQUIRY.
What does this involve?
This involves working toward answering your inquiry questions using the research strategies you identified in Step 3 above.
As you work your way through your inquiry you are required to keep a record of your research. The Record of Research should include:
a)
all information gathered during your inquiry,
b)
completed organisers,
c)
drafts of each section of the final product as submitted to your teacher,
d)
reflection pro formas and
e)
a bibliography of the secondary sources you used.
These items help determine how effectively you have planned, organised, conducted and reflected on your inquiry.
It is also expected that as you proceed with your research and you will develop and/or refine your research focus by developing new inquiry questions and research strategies.


STEP FIVE –ANALYSE THE RESULTS OF YOUR INQUIRY. DECIDE ON THE MOST EFFECTIVE WAYS TO PRESENT THE DATA AND INFORMATION YOU HAVE COLLECTED AND CREATE YOUR AVD. PRESENT YOUR AVD AS PART OF A DISPLAY AT THE PRESENTATION EVENING.
What does this involve?
The task requires you to analyse the results of your research, communicate the results of your inquiry using a genre called an Annotated Visual Display. On this document will be relevant information and data about your ‘footprint factor’ and ‘sustainability strategy’ organised using the key questions of your geographical inquiry.
How do I make the Annotated Visual Display?
The AVD is created in Microsoft Word. It will contain a mixture of text and graphical materials (such as maps, graphs, photographs, diagrams.) arranged on two A3 pages in landscape format. Data presented will be accompanied by analysis written into a text box. Referencing and geographic conventions (BOLTSS) must be applied where appropriate.
The AVD is produced and submitted electronically. However you must print a copy to display on the presentation evening. Examples of AVDs will be shown to you by your teacher.
How do I present the primary data collected?
You need to table or graph statistics you have gathered. Questionnaire results would need to be tallied and presented in a table or graphs. Microsoft Excel and Word 2010 can be used here. Photographs need to be resized and annotated. The Social Science Research Organiser, Word 2010 and Huelab’s Fun with Mindbook can be used to present ideas in mindmaps and other graphic organisers.
Exhibition Extras
As well as your AVD you are required to construct a number of additional items that will be part of your display/exhibition. The two items listed here are compulsory. You may include other items in your exhibition.
Curiosity Box
The Curiosity Box is a container with 10 interesting, open-ended questions about your research for which you have prepared an answer. As guests view your AVD you talk to them about your ‘footprint factor’. Because the guests may know little about your topic, the Curiosity Box provides them with a question to ask you. Hopefully this will start a conversation!
Use your creativity to construct an interesting way to present your Curiosity Box.
Tokens
Tokens are small offerings you can distribute to guests on the night. It allows you to share your understanding of the sustainable strategy in an unusual way. It should be something that relates to your sustainable strategy/recommended action. Use your creativity so that you can pleasantly reward guests who spend some time at your stand.

Saturday, 10 November 2012

Reflections on feedback


Reflections

“Life can only be understood backwards; but it must be lived forwards.”
Søren Kierkegaard

 At first, when I thought about providing feedback to my peers my only thought (and emotion) was, “How on earth am I going to do this?” I felt as if I was  totally unqualified to comment much less give advice to anyone else. I felt I really did not know enough and in retrospect, this was largely true. I think I would have provided far better feedback if I had been at the same stage of my ILA as my peers were in theirs at the time. You don’t really understand something until you have done it yourself and in hindsight I feel I would have been far more helpful if I had experienced the same knowledge and emotions as my peers before commenting on their work. Comparing the quality of my feedback to my peers before I had completed the major posts of my blog with feedback made afterwards, shows the importance of having your own experience before trying to evaluate someone else’s.

I found that providing feedback on someone else’s blog helped me to clarify and understand some of the thoughts and emotions I had been having about my own ILA. To see that my peers had made the same observations that I am presently making; being able to compare experiences and agree on tactics helped me to feel as if I was heading in the right direction.

It was good to receive the benefit of someone else’s wisdom and their advice on what to look for when students fill in the questionnaires. Kerrie’s advice on checking for clarification on responses really hit a chord as I have started doing the stats on the students responses to Questionnaires 1 and 2 and have noticed quite a few responses that need clarification. Both ladies have also experienced the ILA from the viewpoint of an “outsider” as I have done, their advice and observations resonate so closely with mine despite them being different subjects and different age groups. I think we all agree that it would be a very different experience to develop and implement an ILA of our own, from scratch!

I felt really happy that some of my posts had helped my team mates with their research. Kerrie let me know that my annotated bibliography has helped her obtain some references that she found useful and Rachael found my explanation on search strategies helpful, prompting her to re-attempt a  ProQuest search. Coping with the isolation of distance education studies is made far easier when you are openly encouraged to reflect on your own thoughts and emotions as well as that of others. This type of communication is valuable wherever you are, but even more so when you’re doing distance education.  As I explained to Kerrie, getting her response made me feel as if a great weight had been lifted from my mind!

So, once again ladies, thank you so much for your feedback. I really appreciated your insight and knowledge.

Sunday, 4 November 2012

Questionnaire 2. My answers and reflections.



Questionnaire 2


1. Take some time to think about your topic. Now write down what you know about it.


My topic is about middle school students using inquiry learning to do a SOSE unit on their ecological footprint.


2. How interested are you in this topic?  Check (ü) one box that best matches your interest.
Not at all    not much     quite a bit     a great deal

3. How much do you know about this topic?  Check (ü) one box that best matches how much you know.
Nothing      not much     quite a bit     a great deal

4. Thinking of your research so far - what did you find easy to do? Please mention as many things as you like.
I have found it easy to find information.
Finding really pertinent information has proved quite the task though, often I think something is really good until I engage with it and try to summarise why and how its pertinent to my unit, only to find that it wasn’t so good after all.

5.  Thinking of your research so far - what did you find difficult to do? Please mention as many things as you like.
I find it difficult to tease out the information that I really need from the masses of information that I have.
I find it difficult to state things in a concise, clear manner.
I find it difficult to focus and go off on a tangent when I find anything interesting.
Sometimes I think that the information I have is perfect only to reread the task requirements and find that its not really any good at all.
I feel frustrated because things always seem to take three times as long as I originally estimated and the job seems to be getting bigger and bigger instead of fitting into place.

6.  How do you feel about your research so far? Check (ü) one box that best matches how you feel.
Frustrated – I can’t find what I want       
Overwhelmed – I’m finding it hard to sort through the information
Confused – I don’t really know what I’m looking for
Confident – I think I know where I’m heading

A Reflection of my Journey through CLN650, with a comparison to Kuhlthau’s ISP



This post is a reflection of my journey through CLN650, with a comparison to Kuhlthau’s ISP.
Kuhlthau’s Information Search Process describes six distinct stages that students go through during the inquiry process. Each stage describes the feelings, thoughts and actions that students encounter.
Here’s the story of my “encounters”.

At stage 1, “Task initiation”, the student is preparing for the decision to select a topic. Their thoughts usually centre around contemplating the assignment, relating prior experience and learning to the task, and considering possible topics. Often their feelings are vague and apprehensive, with uncertainty about the task ahead. Their activities would be of a seeking nature. They would talk to fellow students and the teacher as well as browse the library, internet and other sources of information. A strategy that they may employ here is brainstorming.  Photo credit

Photo credit


 At the start of this unit I felt curious and alert to anything that even had the word “inquiry” in it. I must admit to feeling a little dismayed that I didn’t know more about this way of teaching. I am a science teacher and apparently “the inquiry method” experienced its genesis in the sciences. Well some of it seems familiar. But there’s a lot that doesn’t! Feelings of inadequacy and uncertainty abound.  I resolve to try and find out as much as possible. I’m sure I know this phenomenon (inquiry teaching)...perhaps I’ve just given it another label?     Photo credi

My thoughts are vague and scattered. Photo credit
I remember seeing the term “inquiry” in science magazines and other professional development documents. I had never really thought of it as being so involved. Surely it’s just a way of teaching? There’s so much I need to know. I jump onto “Google”. I rifle through magazines, books and papers. I need to know more!   [I’m starting to realise that my journey is reflecting the initiation stages of Kuhlthau’s ISP. I’m contemplating the assignment, relating it to my prior experience. My feelings are vague, apprehensive and uncertain. I constantly seek more information.] Photo credit

At Stage 2, “Selection”, the student begins to decide what topic to investigate and how to go about it.
The uncertainty associated with the first stage usually fades, being replaced with a sense of optimism and anticipation. The student weighs their choices against their own personal interests, the topic requirements, the available information and the amount of time they have. Their actions centre around preliminary searches and informal information gathering.
Photo credit


A requirement of my Masters is that I gain experience working in a library. A requirement of this unit is that I teach a unit using “Guided Inquiry” methods.

 

 I feel apprehensive. I don’t teach at present. I don’t have a class. Where will I find one? Maybe I could watch a class being taught using this method? But where? My mind is constantly tuned in to the word “inquiry”. I see an upcoming professional development conference; many of the presentations are on inquiry teaching. I volunteer to help out at the conference. The school hosting the conference is beautiful! The library is exquisite! Their teachers use inquiry methods! The teacher who is considered the expert in inquiry teaching at this school allows me to observe one of her class units! The librarian allows me to do volunteer work in the library! Hallelujah! I start feeling optimistic. Perhaps I can do this?      Photo credit  

But the class only starts next term. I’m supposed to have finished teaching the unit by then. Getting permission from leadership for me to volunteer at the school takes longer than expected. I start feeling anxious. Will I get it done in time? Will I be granted an extension?    [I recognise that I am in the selection phase of Kuhlthau’s ISP. I have a class to observe and even though I did not chose the topic; at least I know what it is! Feelings of optimism and relief alternate with apprehension and doubt. But I am starting to feel more focussed. I know where this is going now.]

In the third stage, “Exploration”, the student gathers information on their topic.
Photo credit

They start to create new personal information but are still unable to express precisely what information is needed. Often the new information they find deviates from their present knowledge. They start to doubt themselves and feel confused. 



Their uncertainty becomes frustration. They start feeling threatened and want to give up. They start to look for something to focus on, some way to tolerate the inconsistency and incompatibility of the information they encounter.  They read a lot and start taking notes on facts and ideas. They make bibliographic citations.  Photo credit        

                                                                     
I start finding out everything I can about inquiry teaching. Our lecturer has introduced us to effective search strategies. I use them and find so much information on the internet. One piece of information leads me onto another. I have papers downloaded from the internet, papers requested from the library, books and magazines strewn all over the desk. I’ve had to create more desk space. So much information. I just think I’ve got my head around one thing and then another interesting fact pops up. Will I ever be able to remember and understand all this stuff?  Will I ever be able to condense it into something tidy and organised and meaningful to me?
Photo credit



My family ask me how everything’s going and what I’m learning about. I start to tell them and realise that I don’t really know what I’m talking about. I feel overwhelmed, confused, frustrated. Nothing I do on the computer seems to work. Will I ever get this? Why did I start it? It’s too much!  Photo credit


Now I start to realise some of the frustrations my students must have experienced during tasks I gave them. I wish I’d known all this then!
Photo credit 
At least my lecturer knows what we go through and she has provided many backups along the way. We have a Facebook group (or brains trust) available any time of the night or day. If that doesn’t work then I know that the lecturer will speedily answer emails and questions that only she would know the answer to. I never really feel alone. And knowing that my classmates are experiencing the same emotions is very reassuring. Just going through Kuhlthau’s ISP is strangely reassuring. At least I know that what I’m experiencing is normal and that there’s light at the end of this tunnel.  I start to relax and trust that everything will work out.

During the fourth stage or “Formulation” phase of Kuhlthau’s ISP students start to evaluate the information that has been gathered. They start to feel more focussed, optimistic and confident. They start to combine unrelated ideas and information and create a focussed personal piece of work. This is considered to be the most important phase of the project.

Photo credit
I must say I’m looking forward to reaching this phase. I’m half way through this unit at the moment. I am starting to feel more focussed and optimistic but I can still see the mountain of work that needs to be done before I can call this assignment complete. I really don’t want to end up trying to mash all the information together in the hope that it will “stick”. I’d far rather develop a focus and theme that will help pull all my knowledge together into a unified whole of my own making. I will need to add to this part of my post later, as I get to experience this phase fully.


The fifth, or “Information Collection” stage is where the student gathers information to support their focus. They start organising their information into notes. They realise that there’s still an extensive amount of work to be done but have confidence in their ability to complete the task. They experience increased interest in the topic. They make comprehensive searches of various types of material, the internet, periodicals, papers and books. They take detailed notes and create bibliographic citations along the way.
                                                                                                                                     Photo credit

I suppose I’m partially at this stage as I have realised there’s still an extensive amount of work to be done, but I do feel more confident about completing the unit. I’ve gathered all my material and I’m starting to organise it in a semi-logical way.



The last stages are “Presentation” and “Assessment”. During these stages the information search is completed. Generally this is the time where summarisation and reporting occurs.
It is at this stage that the student starts to either feel a sense of accomplishment and satisfaction or in some cases disappointment. Usually there is a huge sense of relief. Their self-awareness starts to increase. Rechecking of sources for overlooked information may occur. 
Photo credit


I hope I feel this way when I reach this stage. There is always the danger that I will be dissatisfied with what I’ve produced.