Upload users

An administrator can upload multiple user accounts via text file in Administration > Site administration > Users > Accounts > Upload users.

There are many robust options for uploading information (fields associated with a user) with this method: from enrolling users in multiple courses with course specific roles to updating user information in the User profile to deleting users from the site.

Rather than uploading the text file, it can simply dragged from the desktop and dropped into the upload area, as demonstrated in the screencast Drag and drop new users into Moodle 2.3 (by Mary Cooch).

Tip: It is usually not necessary to upload users in bulk with Upload users. To keep maintenance work down you should first explore forms of authentication that do not require manual maintenance, such as connecting to existing external databases or letting the users create their own accounts (Self enrolment). See Authentication for more information.

Initial upload users screen

Upload user process

Here is an outline of the process:

Create file for uploading
Go to Administration > Site administration > Users > Accounts > Upload users
Add file to upload
Upload users preview - check settings and default user profile settings
Upload users preview - click "Upload users"
Upload users results - shows list of users, exceptions made in upload and summary of number of users
Upload users results - click "Continue"
Returns to Upload users screen

Updating users preview

There are various settings to better control the desired upload behaviour. These settings are found on the "Upload users preview" page.

Upload users preview in Moodle 2.x

Settings

Warning: errors updating existing accounts can affect your users badly. Be careful when using the options to update.

Upload type

The Upload type specifies how to handle existing accounts.

Add new only, skip existing users: is the default Moodle upload type. It creates a new user account for each new record in the uploaded file. If an existing username is found (i.e., the username in the uploaded file matches an existing username, that record is skipped. By skipping the existing user account, the data in the existing record is not touched (in contrast to the "Add new and update existing users" option) and a second new user account is not created (in contrast to the "Add all, append number to usernames if needed" option).
Add all, append number to usernames if needed: creates a new user account for each record in the uploaded file. If an existing user account is found, a new account will be created with a number appended to the username. For example, if a user account for username 'jsmith' already exists and a new record in the uploaded file contains a record for username 'jsmith' an additional user account is created with a 1 appended to the username to produce user 'jsmith1'.
Add new and update existing users: creates a new user account for each new user in the upload file. If an existing user account with the same username is found, the account information is updated by the data in the uploaded file.
Update existing users only: ignores any new users found in the upload file and updates the user account if a matching username record is found in the uploaded file.

New user password

When creating a new user account Moodle can create a new password (if one is not provided) or require a password in the uploaded file.

Create password if needed: creates a default password for the new user account if one is not provided in the uploaded file.
Field required in file: requires that a password be provided in the uploaded file in order. If a password is not provided, an error is generated and the user account is not created.

Existing user details

The Existing user details options are only available when the Upload type allows existing user accounts to be updated. It specifies how Moodle should process user detail information for existing users.

No changes: ignores user detail data in the uploaded and leaves the existing user account data unchanged.
Override with file: overwrites data in the existing user account with the data provided in the uploaded file.
Override with file and defaults: overwrites data in the existing user account with data provided in the uploaded file and fills in the default values for existing user details when no data is provided in the uploaded file.
Fill in missing from file and defaults: adds data in the existing user account with data provided in the uploaded file if the field is empty (does not already contain data) and fills in the default values for existing user details when no data is provided in the uploaded file.

Existing user password

The Existing user password option specifies how to handle password data for existing user accounts when Existing user details is set to overwrite data.

No changes: ignores password field in the uploaded user file and leaves the existing user account password untouched
Update: overwrites the existing user account password with the password provided in the uploaded file

Allow renames

If the uploaded flie contains the special oldusername field, it is possible to rename a user from the oldusername to a new username. The default setting is to not allow renames. Keep in mind that renaming a user will require the user to use the new username when logging in.

No: ignores the oldusername field and leaves the existing user account's username field unchanged.
Yes: allows the existing user account's username to be changed by the data provided in the uploaded file's username field. The oldusername will be searched for and then updated with the data provided in the username column.

Allow deletes

If the uploaded file contains the deleted special field, it is possible to use the upload file to delete existing user accounts. The default setting is to not allow deletes. Keep in mind that deleting a user account will prevent that user from logging in. As a protection, site administrator user accounts cannot be deleted with this method.

No: ignores the deleted special field in the uploaded file and leaves the existing user account unchanged
Yes: allows the existing user account to be deleted when the value of the of the deleted field is 1.

Allow suspending and activating of accounts

If the uploaded file contains the suspended special field, it is possible to use the upload file to either suspend or make active (unsuspend) existing user accounts. The default setting is to allow suspending/activating of existing user accounts. Keep in mind that suspending an existing user account will prevent that user from logging in.

Yes: allows the existing user account to be suspended when the value of the of the suspended field is 1.
No: ignores the suspended special field in the uploaded file and leaves the existing user account status unchanged.

Prevent email address duplicates

Standardise usernames

Select for bulk user actions

Additional Options

There are also fields settings to force password change, allow renames, allow deletes, prevent email address duplicates, standardise usernames and select for bulk operations(new users. updated users, all users).

Standardise usernames - This folds username to lowercase and strips out illegal characters. This is roughly equivalent to:

 $username = preg_replace('/[^-\.@_a-z0-9]/', , $username);

Set default user values

You may be able to set default user field values, if the fields were not included in the uploaded file on this page.

Upload user results

After accepting the preview settings by clicking on "Upload users", you should see the the Upload users results screen.

The results screen; everything went well!

This screen will show you any exceptions or changes that were made to each user in the upload process. For example if you were updating user information, the updated information will be shown. Or if a user was not added that record will be highlighted.

The screen will summarize how many users were uploaded or updated, indicate the number of weak passwords and the number of errors.

File formats for upload users file

The upload users file has fields separated by a comma (or other delimiter) ONLY - no space. The first line contains the valid field names. The rest of the lines (records) contain information about each user.

:Tip: Avoid special characters in field information like quotes or other commas. Test a file with only one record before a large upload. Remember there are other ways to authenticate users on you site or enroll users in a course.

:Tip: You can use a spread sheet program to create the file with the required columns and fields. Then save the file as "CSV (comma delimited)". These files can be opened with simple text editors for verification.

Valid upload file for testing

Here is an example of a simple valid upload file: (Column headers on the first line of the file are only highlighted in bold in this example to distinguish it from the rest of the of the data/user details)

username,password,firstname,lastname,email,course1,group1,cohort1
jonest,verysecret,Tom,Jones,jonest@someplace.edu,math102,Section 1,year 3
reznort,somesecret,Trent,Reznor,reznort@someplace.edu,math102,Section 3,year 4

Fields that can be included

:Tip: We strongly recommend that you test a file that contains fields you proposed to use with one user before attempting a file upload for the first time. http://demo.moodle.net might be a good place to see if your test file works.

Required fields:

username,firstname,lastname,email

Validity checks are performed for:

username can only contain alphabetical lowercase letters , numbers, hypen '-', underscore '_', period '.', or at-sign '@'
email is in the form: name@example.com .

Password field: "password" field is optional if "Create password if needed" setting is chosen (default).
- If included, values should meet the requirements for the site's Password policy. To force password change for a particular user, set the password field to changeme.
- If omitted, a password will be generated for each user (during the next Cron job) and welcome e-mails sent out.
- Note: the text for the welcome e-mail is in the language settings. Please refer to this forum threadfor details.

Optional fields: To provide values other than the default include one or more of these

institution,department,city,country,lang,auth,timezone,idnumber,icq,phone1,phone2,address,url,description,mailformat,maildisplay,htmleditor,autosubscribe

Additional name fields
Country- use a country TWO LETTER CODE
Some fields have a maximum number of characters that are allowed (notably institution should be at most 40 characters long). See hints below.
Maildisplay, htmleditor and autosubscribe can be set from an import screen.

Custom profile field names: (Optional). xxxxx is the real custom user profile field name (i.e. the unique shortname)

profile_field_xxxxx

Create the custom fields BEFORE importing. Use the standard header. The "shortname" for your custom field is xxxxx (NB the shortname must be all lowercase, otherwise won't be recognised). The first record must include "profile_field_xxxxx".

Example: To create a custom field "genre", you must write a shortname "genre" in the new field, and write "profile_field_genre" in the header of the .csv file.

For custom profile fields that are a menu, use the corresponding value (new in Moodle 2.3 onwards).

For custom profile fields that are dates, use the ISO standard format YYYY-MM-DD, eg. 2014-06-19 which will then be properly localized in the interfaced.

Example: A custom field 'Department' with one of three values 'HR', 'Marketing' or 'Training'. Just insert one of those three words (e.g. 'Training') as the value for that field.

Special fields: Used for changing of usernames or deleting of users

oldusername, deleted, suspended

Enrolment fields: (Optional):

course1,type1,role1,group1,enrolperiod1,enrolstatus1,course2,type2,role2,group2,enrolperiod2,enrolstatus2 etc.

Header fields must have a numeric suffix such that type1,role1,group1,enrolperiod1 and enrolstatus1 all apply to course1 for course1 to coursen.
course is the "shortname" of the course, if present the user will be enrolled in that course.
type sets the role to be used for the enrolment. A value of 1 is default course role, 2 is legacy Teacher role and 3 is legacy Non-editing Teacher.
role may be used to specify roles directly, using either role short name or id (numeric names of roles are not supported).
group may be used to assign users to groups in course, using name or id (numeric group names are not supported)
enrolperiod may be used to set the enrolment duration, in days, for each course.
enrolstatus can suspend users from a course when set to 1 or left blank for enrolled.

Cohort field: (Optional):

cohort1

Internal cohort id numbers or non-numeric Cohort IDs of existing cohorts must be used; names are not allowed.

mnethostid (Optional)

Existing MNetusers can be added to courses, groups or cohorts as below:

enrolling to courses: username+mnethostid+course required
adding to group: username+mnethostid+course+group required
adding to cohort: username+mnethostid+cohort required
suspending/reviving accounts: username+mnethostid+suspended required

All other operations are ignored. You can not add users, delete them or update them (such as change names or email, profile fields, etc.)

Commas within a field must be encoded as &#44 - the script will decode these back to commas.

For Boolean fields, use 0 for false and 1 for true.

To prevent users from receiving a large number of emails from courses or forced subscription forums use the maildigest. The options for this field are 0 = No digest, 1 = Complete digest and 2 = Digest with just subjects.

Advanced potentials of Upload user

Templates

Note: This section needs checking and updating if necessary for Moodle 2.0. Please do so and remove this note when finished.

The default values are processed as templates in which the following codes are allowed:

%l - will be replaced by the lastname
%f - will be replaced by the firstname
%u - will be replaced by the username
%% - will be replaced by the %

Between the percent sign (%) and any code letter (l, f or u) the following modifiers are allowed:

(-) minus sign - the information specified by the code letter will be converted to lowercase
(+) plus sign - the information specified by the code letter will be converted to UPPERCASE
(~) tilde sign - the information specified by the code letter will be converted to Title Case
a decimal number - the information specified by the code letter will be truncated to that many characters

For example, if the firstname is John and the lastname is Doe, the following values will be obtained with the specified templates:

%l%f = DoeJohn
%l%1f = DoeJ
%-l%+f = doeJOHN
%-f_%-l = john_doe
http://www.example.com/~%u/ results in http://www.example.com/~jdoe/ (if the username is jdoe or %-1f%-l)

Template processing is done only on default values, and not on the values retrieved from the CSV file.

In order to create correct Moodle usernames, the username is always converted to lowercase. Moreover, if the "Allow extended characters in usernames" option in the Site policies page is off, characters different to letters, digits, dash (-) and dot (.) are removed. For example if the firstname is John Jr. and the lastname is Doe, the username %-f_%-l will produce john jr._doe when Allow extended characters in usernames is on, and johnjr.doe when off.

When the "New username duplicate handling" setting is set to Append counter, an auto-increment counter will be append to duplicate usernames produced by the template. For example, if the CSV file contains the users named John Doe, Jane Doe and Jenny Doe without explicit usernames, the default username is %-1f%-l and New username duplicate handling is set to Append counter, then the usernames produced will be jdoe, jdoe2 and jdoe3.

Deleting accounts

If the deleted field is present, users with value 1 for it will be deleted. In this case, all the fields may be omitted, except for username. After uploading the file, be sure to change the "Upload type" to "Update existing users only" and the "Allow deletes" option to "Yes".

Tip: A similar field is available for suspended. This enables a user account to be temporarily disabled rather than completely removed.

Deleting and uploading accounts could be done with a single CSV file. For example, the following file will add the user Tom Jones and delete the user reznort:

username,firstname,lastname,deleted
jonest,Tom,Jones,0
reznort,,,1

Encoding file format

On the initial Upload user screen, you may select the file encoding format from a pull down list. These include UTF-8 (the default), ASCII, ISO-8859-1 to ISO-8859-11 or any one of over 36 formats.

Hints

Spreadsheet

If you use a spreadsheet program such as Excel to create your .csv file, check the resulting output in a text editor before you upload it. It is possible to get trailing commas on each line from an empty field if you have added and deleted columns of information prior to saving the final file. Also check the character encoding. A csv file is a simple text file (ASCII or Unicode) that can be used to upload user accounts.

Excel translates passwords that begin with - (minus) or + (plus) as zero. Even when saving as .csv and saying "Yes" to "Keep this format, and leave out any incompatible features." Check for this before uploading, as a zero halts the upload process.

If you use a formula in Excel to create fields (for example, the concatenate function to create a user name), then remember to copy the cells with the formula and use special paste with values checked to make them into an acceptable data for a csv file.

The upload will also fail if you have trailing spaces at the end of your data fields. Often, this can not be removed with a simple Find " " and Replace with "". If information has been copied from web sources than it is possible to include non-breaking spaces which will prevent your upload from being completed correctly. To find these invisible spaces, use the Find and Replace function in Excel. In the find field, hold alt and type 0160. Leave the replace field blank.

Country

The country should be written as a two letter code, in capitals. For example, use BE for Belgium or NL for the Netherlands. Using "be" or "nl" as a country code will result in a database error.

Tip: If you are having trouble working out the two-letter code for a country, you can consult the list of country names and code elements available on the ISO Website. A common error is to use UK for United Kingdom; it should be GB.

Field size limits

Some fields have maximum character lengths. Typically the file will import to the preview list screen but not finish the process. Turn on debug to see the fields that are too long. Common fields to cause problems are "Institution" which is limited to 40 characters, and "City", also limited (20 characters). The error will be "User not added - error".

Time zones

The entry is case sensitive so Europe/London will work but europe/london will not.

All fields listed here

All the fields that are valid are listed below, except for any custom fields you may have created.

firstname, lastname, username, email, city, country, lang, timezone, mailformat, maildisplay, maildigest, htmleditor, ajax, autosubscribe ,institution, department, idnumber, skype , msn, aim, yahoo, icq, phone1, phone2, address, url, description, descriptionformat, password, auth, oldusername , deleted, suspended, course1, course2, course3, course4

Enroll users to Cohorts (system groups)

You can enroll users to any Cohort (system level group) by using only the "username" and the "Cohort ID". Here is a sample CSV file:

username,cohort1
teacher1,system-teachers
teacher2,system-teachers
teacher3,system-teachers

Make sure you set "Upload type" to "Update existing users only" (So you are not asked to add firstname, lastname and email fields too)

Documentation