Note:

If you want to create a new page for developers, you should create it on the Moodle Developer Resource site.

MoodleNet: Difference between revisions

From MoodleDocs
No edit summary
No edit summary
Line 20: Line 20:
* NodeJs v16+ https://nodejs.org/
* NodeJs v16+ https://nodejs.org/
* ArangoDB (we suggest using [https://www.docker.com/ Docker])
* ArangoDB (we suggest using [https://www.docker.com/ Docker])
* Visual Studio Code https://code.visualstudio.com/
* We recommend the open source IDE Visual Studio Code https://code.visualstudio.com/
=== Setup development environment ===
=== Setup development environment ===
'''From the command line interface (CLI):'''
'''From the command line interface (CLI):'''


Ensure ArangoDB is running on localhost
Ensure ArangoDB is running on localhost.  You may use Docker with a command as below that can be tweaked as needed to ensure it is listening locally on port 8529:
  docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb
  docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb
Clone the repository
Clone the repository, you may wish to fork it, but that's not required:
  git clone <nowiki>https://gitlab.com/moodlenet/moodlenet.git</nowiki>
  git clone <nowiki>https://gitlab.com/moodlenet/moodlenet.git</nowiki>
Initialize the project
Change to the project's folder:
  cd moodlenet
  cd moodlenet
Install and initialize the project:
npm install
Install a development deployment:
npm run dev-install-backend [install dir name]
We have used "my-dev" as [install dir name] in the following instructions.


  yarn
You’ll find the newly created dev-installation in .dev-machines/my-dev and can create as many dev installations as you wish.
 
Run development backend:
  npm run dev-start-backend my-dev
The first run of the system takes some time to install.
 
Once installed, browse http://localhost:8080


yarn init-dev
Install a development deployment
yarn dev-install-be my-dev
Run development backend
yarn dev-backend my-dev
Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
== Creating MoodleNet packages ==
 
=== The moodlenet extension package template ===
You can use core MoodleNet development environment and processes to develop your packages.
 
We recommend to start understanding the extension framework tweaking the template package “my-moodlenet-mjs-pkg-template” you’ll find it in the folder “packages”.
 
It is written in Javascript (EMS) instead of Typescript for a better understanding by newcomers.
 
Using typescript for package development is strongly recommended, as ts-experienced-devs will take advantage of the strongly-typed framework.  However this requires good typescript knowledge, and some measures and ceremonies as all MoodleNet official packages are written in Typescript.
 
=== Install my-moodlenet-mjs-pkg-template ===
Signup using the web-app .
 
Note: Do not use sensible passwords as the system saves the email-password credentials unencrypted in the database.
 
Since no SMTP has been configured, the signup confirmation email supposed to be sent will be logged in the terminal:
 
hey {display name} confirm your email with /.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
 
Copy the url path (/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}) apply the localhost and paste it to the browser to confirm your email
 
localhost:8080/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
 
You’ll be logged in automatically and will be able to use the chosen credentials to login other times
 
When logged-in, navigate to the settings page in advanced section, where you can enable "dev mode”.
 
Then proceed to extensions / install extension section and submit the package absolute path to your package local folder.
 
The system will install the package and restart.
 
It will take some time to rebuild the web-app to see the results
 
Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
 
== Creating custom MoodleNet packages ==
A Moodlenet package is a standard [https://nodejs.org/api/esm.html#introduction ESM] package defining a main [https://nodejs.org/api/esm.html#introduction ESM] module.
A Moodlenet package is a standard [https://nodejs.org/api/esm.html#introduction ESM] package defining a main [https://nodejs.org/api/esm.html#introduction ESM] module.


Line 60: Line 101:


  }
  }
===== Declare dependency =====
===== Declare dependency =====
Your MN package must declare its dependency to the @moodlenet/core package.
Your MN package must declare its dependency to the @moodlenet/core package.

Revision as of 08:35, 7 December 2022

Moodlenet-logo.png

What is MoodleNet?

MoodleNet is a flexible Open Education Technology platform for curating collections of the best known Open Educational (and other) Resources. You'll find more general information in the MoodleNet user documentation.

If you are looking to get started as a MoodleNet developer, we recommend taking the MoodleNet for Developers course with Moodle Academy.

Current status

Take a look at MoodleNet releases in our Tracker.

Roadmap

MoodleNet architecture

MoodleNet is a full stack TypeScript/JavaScript system using:

  • NodeJs
    • NPM Packages [1]
    • ESM Modules [2]
  • Browsers

MoodleNet development environment

Setup development environment

From the command line interface (CLI):

Ensure ArangoDB is running on localhost. You may use Docker with a command as below that can be tweaked as needed to ensure it is listening locally on port 8529:

docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb

Clone the repository, you may wish to fork it, but that's not required:

git clone https://gitlab.com/moodlenet/moodlenet.git

Change to the project's folder:

cd moodlenet

Install and initialize the project:

npm install

Install a development deployment:

npm run dev-install-backend [install dir name]

We have used "my-dev" as [install dir name] in the following instructions.

You’ll find the newly created dev-installation in .dev-machines/my-dev and can create as many dev installations as you wish.

Run development backend:

npm run dev-start-backend my-dev

The first run of the system takes some time to install.

Once installed, browse http://localhost:8080

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

The moodlenet extension package template

You can use core MoodleNet development environment and processes to develop your packages.

We recommend to start understanding the extension framework tweaking the template package “my-moodlenet-mjs-pkg-template” you’ll find it in the folder “packages”.

It is written in Javascript (EMS) instead of Typescript for a better understanding by newcomers.

Using typescript for package development is strongly recommended, as ts-experienced-devs will take advantage of the strongly-typed framework. However this requires good typescript knowledge, and some measures and ceremonies as all MoodleNet official packages are written in Typescript.

Install my-moodlenet-mjs-pkg-template

Signup using the web-app .

Note: Do not use sensible passwords as the system saves the email-password credentials unencrypted in the database.

Since no SMTP has been configured, the signup confirmation email supposed to be sent will be logged in the terminal:

hey {display name} confirm your email with /.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}

Copy the url path (/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}) apply the localhost and paste it to the browser to confirm your email

localhost:8080/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}

You’ll be logged in automatically and will be able to use the chosen credentials to login other times

When logged-in, navigate to the settings page in advanced section, where you can enable "dev mode”.

Then proceed to extensions / install extension section and submit the package absolute path to your package local folder.

The system will install the package and restart.

It will take some time to rebuild the web-app to see the results

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

Creating custom MoodleNet packages

A Moodlenet package is a standard ESM package defining a main ESM module.

@moodlenet/core will import it at startup.

// package.json
{
  "name”: "my-moodlenet-package”,
  "version”: "1",
  "type": "module",
  "exports": {
    ".": "./src/server/main.mjs"
  }
}
Declare dependency

Your MN package must declare its dependency to the @moodlenet/core package.

The core will import the main module at startup. The package "connects” to the core:

// package.json
{
   "peerDependencies”: {
     "@moodlenet/core”: "^0.1.0”
  }
}

When adding/removing peerDependencies in the main repository based development environment, remember to execute:

yarn bs

to link dependent packages.

// src/server/main.mjs
import { connectPkg } from '@moodlenet/core'
const connection = await connectPkg(import.meta, { 
  apis: { } 
})
Test the package template
  • adding the template package in installation dependencies
  • delete "installed” prop in the MoodleNet lock file
  • restart the backend

Edit .dev-machines/my-dev/package.json adding the template package folder as dependency, similarly to other core package dependencies.

// .dev-machines/my-dev/package.json
{
  ...
  "dependencies”:{
    ...
    "my-moodlenet-mjs-pkg-template”: "file:[repofolder]/packages/my-moodlenet-mjs-pkg-template”
  }
}
Define and deploy APIs

Your package will probably need to define and deploy its own APIs.

APIs are simply a collection of async functions - along with a params formal validation function - organized in a structured Js object.

APIs will be registered in the system with a path-like string, having your package name as prefix and apth following api structure.

// src/server/main.mjs
import { connectPkg, defApi } from '@moodlenet/core'
const myApis = {
  hello:{
     world: defApi( ctx => 
        async (p1,p2) => { return // something } , 
       (...params) => { /* … validate params */ }
  )
}
const connection = await connectPkg(import.meta, { 
  apis: myApis 
})
// will register 1 api: 
// my-moodlenet-package/1.0/hello/world
Extend the web application

Use @moodlenet/react-app "plugin” api, during initialization to extend the web-app with a custom set of components.

import { pkgConnection } from '@moodlenet/core'
import reactApp from '@moodlenet/react-app'
const reactAppPkg = await pkgConnection(import.meta, reactApp)
await reactAppPkg.api('plugin')({
  mainComponentLoc: 
     [‘path’, 'to', 'MainComponent.jsx']
})

The react-app will inject your MainComponent.jsx in the web-app codebase, recompile and bundle (webpack) and serve the new extended webapp.

APIs access

Apis can be accessed by any package in system running in backend’s NodeJs process using specific @moodlenet/core functions pointing to the path of the desired API.

// from within the backend:
// locate an package api by path
import myMNPkgConn from
   ‘my-moodlenet-package’
const myMNPkg = await pkgConnection(import.meta, myMNPkgConn)
const helloWorldApi =
  myMNPkg.api(‘hello/world’)
// call api as an async function
const result = await
  helloWorldApi(helloParam, worldParam)
APIs Primary Adapters

Primary adapters implement API accessibility from external processes using some transport and protocols. Currently MoodleNet provides one Api-primary-adapter to access APIs by HTTP, which is implemented by @moodlenet/http-server. @moodlenet/http-server API HTTP adapter exposes package APIs as HTTP-POST endpoints. That endpoint is a path comprising the package name and the defined API path base, after the base API endpoint ( currently .pkgs ), having a JSON object body representing the api arguments. For example,

.pkgs/my-moodlenet-package/1.0/hello/world

body:

{

 "args” : [

   "hello-param1”,

   "world-param2”

 ]

}

Furthermore, in the web-app, @moodlenet/react-app provides libraries to use a syntax similar to within-backend-access for easy and strongly typed API calls to the server.

APIs Access Control

Packages register apis to @moodlenet/core which mediates api-call requests and responses, performing all fundamental checks and access controls.

  • checks requested pkg version against deployed pkg version for granting compatibility
  • calls api’s params formal validation function before forwarding to actual api function
  • (TBD) checks matching of scopes associated with api and caller (user or package)
  • provides the api a call-context holding an extensible set of metadata (e.g. user session, caller pkg … )
  • (TBD) any package can register for adding context metadata to an api call
APIs Authorization Scopes (TBD)

The core will export functions to define package-specific auth-scopes - similar to OAuth specs.

defApi() will provide options to apply own or other-pkg’s auth-scopes to api.

All Api accesses will be authorized at core level checking scopes assigned to api against scopes assigned to caller. Note that the caller may be a user using some primary adapter e.g. HTTP or can be simply another package, on its behalf, from within the system.

Packages will have to declare which scopes they will need to be granted in order to perform their functionalities.

Package scope-dependencies should be granted by the admin at installation time in order to complete the installation - similar to what happens on smartphones.

Testing MoodleNet packages

Once we’re happy with package development on dev-environment, we can try to install it on a real MoodleNet installation, using the admin UI.

Installation of MoodleNet in a production-like environment is a one liner cmd:

npx install \ @moodlenet/create \ dest/folder

Ensure ArangoDB is running and once inside the "dest/folder" installation directory:

npx @moodlenet/core

Create a user and navigate to the settings page where you can enable "dev mode”. Then proceed to extensions/install section and submit the package absolute path to local folder.

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

Important links