ILRT, University of Bristol, UK g.conole@bristol.ac.uk

1. Setting the context

In recent years developments in Information and Communication Technologies have led to a growth in the range of Internet-tools which can be used for learning and research. Research and development into the creation of content-rich digital libraries has developed to a large extent in isolation from research and development into the creation of online learning resources and virtual learning environments (VLEs). What defines and distinguishes a VLE from a digital library? This paper contends that we need to first examine the components already in place, to look at how they are related and will help users to better understand the power and offerings of the current technologies to support our learning and research activities.

In recent years there has been an exponential increase in the range of online learning environments and associated tools to support learning and research. These range from stand alone communication tools such as email, discussion boards and synchronous chat, authoring facilities and assessment tools right through to more integrated learning environments such as Learning Space, WebCT and Blackboard. Coupled with this there is now supposedly a range of tools to facilitate searching, ranging from search engines like Alta Vista and Yahoo to more subject specific information gateways and portals. Despite this there is little evidence of wide spread uptake in the use of these technologies within education (Jones, 1996; MacKenzie and Wajcman, 1985; Bijker, Hughes and Pinch, 1987). A recent report concludes ‘amongst the factors that are slowing the uptake…is the lack of a coherent framework within which to evaluate both the pedagogical benefits and the organisational changes required to effectively implement it’ (Britain, 1999). Evaluation research to date shows that it is difficult to encourage true virtual learning or collaboration. Discussion board use, for example, often shows a pattern of peak use directly related to teacher intervention or responses to particular hot spot topics. Collaborative group work needs to be carefully set up and orchestrated to achieve desired results and despite this may still end up as a rather stilted collaboration exercise not comparable with direct face to face equivalent group work (Jones, 1999). Integrated learning environments are still predominantly used as a shell to display Web pages and rarely get beyond basic information dissemination and administration. With respect to information seeking and handling, the volume of information available to researchers and learners is increasing exponentially, unmatched by the sophistication of the searching and handling tools (Lawrence and Lee Giles, 1999). Information overload, coupled with confusion as to where to look, is becoming increasingly problematic and despite a growth in the range of searching tool and portals, it is still not evident that the right information is being dispatched to the right users in a timely and quality assured fashion.

This paper will describe an online resource (Biz/ed) that attempts to address many of the issues outlined above. It provides a subject-based focus for learning resources and integrative models and simulations to enhance learning and provide a rich student-centred flexible environment. The paper will describe the main features of the resource and map it to underlying pedagogical frameworks, which will be outlined in the next section.

2. Background to Biz/ed

1. Biz/ed Framework Concept

The success of Biz/ed is due, in part, to the development of a number of separate learning tools which are used to highlight/access different features on the site. These tools are essentially highly scaleable and could be rolled out for use by a range of users. This paper documents the Biz/ed framework, the different tools that have been used and provides a clear vision of how pedagogically sound learning materials can be developed and made more widely available. The generic framework can be used to enable others to develop their own tailor–made jigsaw-kits for creating subject-specific VLEs.

An examination of the types of learning tools used by Biz/ed illustrates how different learning tools can be used to support different aspects of the learning process. For example, some tools can be used to enable resource discovery, while others might facilitate group work and the development of communication skills. These are described in more detail below.

2. Tools for modelling and simulation – the Virtual Learning Arcade

In association with the Institute for Fiscal Studies and Warwick and Oxford Universities, Biz/ed has helped to develop methods for making complex models available online for experimentation by users. For the Virtual Learning Arcade we have taken this work one stage further and developed the basis of a generic tool for making spreadsheet models available over the Web. Such models, and the generic system developed by Biz/ed, are highly transferable into other subject areas, as the initial skills required to develop the models are those that many teachers and lecturers already have. Models and simulations are a very effective learning tool, enabling iterative experimentation for students of a number of different scenarios. These models and associated learning materials can help to encourage a variety of both lower and higher order skills. The project workshops will support users in producing their own Web-based models and associated learning materials.

3. Interactive tools

In association with key publishers and the FT (Financial Times), Biz/ed has created a series of interactive questions and worksheets using a unique tool called CALnet. This has led to the development of interactive banks of questions, case studies and other resources, which are used in a variety of ways to support learning. This approach can be adapted for other subject areas, to create a generic version of the interactive question and worksheet tool. A range of other scripts and interactive materials could also be developed and developed into generic tools for use in other subject areas.

4. Tools to support discussion

Biz/ed has developed a wide variety of other approaches to enhancing discussion. Sections like "Wanna Argument" can be very effective in applying theory to real-world problems and issues, and the ‘On the Case’ has shown how a case study approach can help to apply theory to current events and issues. Topical perspectives on a subject can be highly motivational for students and help them to apply theory and the underpinning methodology in an every day context.

Biz/ed has also been involved in developing synchronous communication tools to support learning, with online chats with examiners. The project will look at the ways in which users can effectively incorporate these tools into an overall package of learning resources.

5. Access to datasets

In the TimeWeb project Biz/ed and MIMAS have been developing a Web-based interface to the MIMAS data and producing learning materials to help support the use of this data. The subject-specific sections of the TimeWeb project could also be re-purposed for use in other subjects. Access to these kinds of large datasets is clearly of significant benefit in terms of supporting learning.

6. Tools for creating online tutorials – the RDN Virtual Training Suite (VTS)

Biz/ed has also been closely involved in the development of the RDN Virtual Training Suite, a suite of nearly 50 online subject-specific introductions to the Internet (www.rdn.vts.ac.uk). In particular, Biz/ed staff wrote the Internet Business Manager, as well as co-writing Internet Economist. Biz/ed staff are also now involved in the development of the new VTS tutorials for the FE community. These resources sit alongside the JISC-funded Resource Discovery Network (RDN) which provides access to a set of quality assured subject based resources and digital libraries.

 

7. Tools for modelling and emersion - Virtual Worlds

The Virtual Worlds concept attempts to provide a rich, contextualised learning environment, which is both stimulating and educational. The users are encouraged to actively participate and engage with the resource.

 

1. Virtual Factory

The original conceptualisation of the Virtual Worlds section began with the Virtual Factory (http://www.bized.ac.uk/virtual/cb/). It is becoming increasingly difficult for students to get access into firms to try to apply the theoretical principles they have learnt to real-world problems and issues. The aim behind the Virtual Factory was to give students the opportunity to get inside a factory from a distance and see how the various business functions (production, marketing, purchasing, accounting and so on) are carried out. A further aim was to help raise a variety of issues that were faced by this company in trying to maintain its competitive position in the market.

However, that alone was not felt to be sufficient. One problem with online materials is the tendency for students to take a cursory look at the resources and feel they have done enough. They tend to be less willing to read as great a volume of text on-screen as they would with more conventional resources (Nielsen, J. 1997). To encourage students to explore further, we felt it was vital to integrate the information about the company with supporting educational materials based around their curriculum. The intention was to encourage students to learn by exploring and questioning. This meant creating an integrated package that also contained worksheets and sections that raised issues and problems for them to consider. This approach ensured that the resource fitted in with the design criteria set out for Web-based constructivist learning (Lefoe, 1998) and prevented students from simply being "passive recipients of information". Using the power of hypertext to link all the materials together and integrating the worksheets with the rest of the information delivered this outcome. The design therefore required a consistent user-interface to be used throughout the site. In this way students could explore at their own pace and take their own direction through the site. There was no need for a conventional linear approach, but they would be able to tailor their learning to their requirements. At the same time there would be worksheets and other resources available to help them focus this learning and to help give them some suggested directions. Navigation around the site is done mainly by clicking on a floor plan of the factory. This was felt to be a straightforward and intuitive user interface and subsequent evaluation has shown this to be true. Text-based links are always available and there is also a universal navigation bar (done as a ‘server-side include (SSI)’) at the head of each page. (See Figure 1 – Virtual Factory Home page)



The Virtual Factory will be upgraded and further developed in the latter half of 2000 to add a greater degree of interactivity to the site. There will be some interactive on-screen worksheets on the basic business principles and in the rest of the worksheets students will be able to type their answers and submit them. They will then receive back a sheet with their answers lined up against some suggested answers or questions they should perhaps have considered.

 

2. Virtual Economy

The intention behind creating the Virtual Economy on Biz/ed was to use the power and reach of the Web to give students the ability to experiment on a high quality and sophisticated model of the economy. The idea stemmed from work that had been done by the Institute for Fiscal Studies in the UK. They had a tax and benefit model (Tax-Ben) that showed the impact of different tax and benefit changes on a variety of different families and income groups. They made this available on the Internet in 1997. At the same time The Macroeconomic Modelling Centre at Warwick University created a ‘ready-reckoner’ which enabled examination of the comparative properties of a variety of well known macroeconomic models (Church, K.B. et al, 2000). This package distilled three different well-known macro models and made the results available to people on a floppy disc based version. We felt that if we could combine a macro model with a micro model, then users would be able to try out a variety of policies and see the effects, not just on the principal economic targets but also on the individuals.

Having received a grant from the Nuffield Foundation to develop this work, we began in 1998. The IFS Tax-Ben model was integrated with an adapted version of the HM Treasury model developed by the UK government. These were combined technically and given a universal front end where users could input the policies they wanted to try. The input is done through an HTML form where users can choose to change a wide range of variables ranging from interest rates and government expenditure to income tax and the taxes on alcohol and cigarettes. Users then select the change they would like to make from a range of options and submit their policies. The model is solved (using a block of Fortran code) and the results sent back as a long HTML page including graphs and data to how exact changes. The first thing to load is a series of summary graphics for both the macro variables and the families and these show the approximate changes. Clicking on any of these takes the user to a detailed breakdown of the change.

Figure 2 – Results page of the Virtual Economy



Surrounding all of this is an integrated set of materials that give full details about all variables in the model. For each economic outcome (economic growth, inflation, unemployment and public borrowing) and each economic instrument (taxation (direct and indirect), government expenditure and interest rates) there is a full explanation of the meaning of that variable, related economic theories and a set of worksheets.

The worksheets are all carefully differentiated and developmental in their approach. They are intended to help students to develop both lower order skills like knowledge and factual-recall, but also higher order skills like evaluation and synthesis. They aim to achieve this by being progressive in nature. Early questions may encourage them to reinforce their knowledge of a particular area by linking across to some of the explanations or theoretical material. Gradually the questions then move up in an ‘incline of difficulty’ and suggest strategies and policies that they can try on the model. They can then try to apply the theory to the results they get and see the extent to which theory matches reality. Open-ended questioning then raises further issues and gets them to consider where the assumptions made in the course of developing theory may break down in practice. In this way they can look at the application of theory to reality through a process of experimentation, but also develop a better appreciation of the interconnected nature of much of the subject matter of economics. This vital higher order skill of synthesis is the ultimate aim of a large-scale integrated learning resource of this nature.

The development of a consistent user-interface for the whole site was vital to achieving this outcome, and much thought went into the development of this. User evaluation had shown that the symbolism of the ‘clickable’ factory floor in the Virtual Factory had been a very powerful navigation tool, but this was more difficult to achieve with a Virtual Economy. After all just what does symbolise an economy? We chose to use the concept of a floor plan once again, but this time we chose Number 11 Downing Street – the home of the Chancellor of the Exchequer. By having a number of floors where the materials progress from the more general introductory material through to the more complex economic theory we felt users would have a logical navigation structure throughout the site. On each floor they can click on a variety of different offices to access the available resources. One of the floors is also a library where there is a full glossary and a timeline of the development of economic theory and the economists who created it. To follow the theme of integration throughout the whole site, every glossary item is highlighted throughout the site and linked to the glossary in the library. The Virtual Economy can be found at: http://www.bized.ac.uk/virtual/economy/

 

3. Current Projects: Virtual Developing Country and Virtual Bank of England

1. Underlying principles and methodology

1. Evaluation

This section will describe the ongoing formative evaluation of the site that is carried out. This takes the form of statistics about site usage, case studies of how lecturers are using the materials and feedback from users.

1. Statistics

Statistics on the use of the site and the ways in which users are navigation through the materials is logged as routine, users are also encourage to submit feedback online. Figure 3 illustrates the exponential growth in the use of the site over the last 18 months. It is perhaps significant to note that this growth can be directly correlated to the increase of enhanced features of the site, particularly the development of the Virtual Worlds section of the site. Statistical reports are regularly generated from the Biz/ed server logs and these allow us to determine the relative usage levels of different parts of the site, right down to the level of individual pages. Some attempts are also made to determine where users are located. For example, we can determine relative usage of particular HE or FE institutions, although this is problematic, because many users connect from ISPs (Internet Service Providers) at home. The dramatic growth in usage of Biz/ed is also monitored in other ways. For example, in the last week of March 2000, 15864 distinct hosts were served, of which 8571 had not been served to in the previous 15 months. Biz/ed will shortly be attempting to track users more carefully using a cookies-based method. This will allow more detailed monitoring of how users actually use the site by providing, for example, information on the exact route taken through the site and how long was spent on each page. Each section of Biz/ed is tracked individually and regular analysis is undertaken of the way in which users interact with the resources.

Figure 3 – Biz/ed Access Statistics January 1996 – October 2001



2. Case Study: Using Biz/ed to support teaching and learning at the University of the West of England (UWE).

At the University of the West of England, Biz/ed has been used very successfully with all 800 first-year students in their business school. The Virtual Economy, while based around the UK economy, also has a series of fictional case studies of firms and individuals to encourage students to consider the impact of economic policy on these groups. The Virtual Economy has been incorporated into lectures and was the basis of a 2,500-word assignment on how different economic policies affect business.

3. Feedback

Feedback from users confirms that they react positively to the advanced features of Biz/ed particularly those in the Virtual Worlds section as the following quotes illustrate:

"Fabulous site…brilliant resources…excellent idea…very well done. This will be used time and time again. Thank you!" Peter Thompson, lecturer, The Isle of Wight College

"Excellent work. These pages are enjoyed by both me and my students." David Jones, Anglo European School

"This is an exceptional site. I’m pleased to have blundered across it. From all appearances this will be useful for my beginning economics students. Thanks." Will Fowler, teacher, Novato, California

"Thank you for providing a well structured, innovative site with exceptional content. Simply one of the best and certainly most informative sites I have come across!" Ryan Harris, student, Canterbury, Kent

What is evident from this is that users are engaging with the learning materials and find the multifaceted interactivity of the site stimulating. Equally important is the fact that the materials are within context and there is a cohesive learning environment for different activities and work packages.

2. Conclusions

The work described in this paper has investigated two main areas: the design and development of Web sites to support learning, A review of the underlying theories has been presented and examples of the ways in which researchers and developers are trying to apply theory to develop better, more educationally focused online learning.

A specific attempt to provide a stimulating, engaging online environment has been described. The general architecture of the Biz/ed Web site has been described along with descriptions of each of the components and their purpose.

3. Acknowledgements

Britain, S. and Liber, O. (1999), ‘A framework for pedagogical evaluation of virtual learning environments’, JISC JTAP final project report, http://www.jtap.ac.uk/reports/htm/jtap-041.html.

Nielson, J (1997) How Users Read on the Web, Jakob Nielsen's Alertbox for October 1, 1997 http://www.useit.com/alertbox/9710a.html