Note:

If you want to create a new page for developers, you should create it on the Moodle Developer Resource site.

MoodleNet: Difference between revisions

From MoodleDocs
No edit summary
No edit summary
(One intermediate revision by the same user not shown)
Line 24: Line 24:
'''From the command line interface (CLI):'''
'''From the command line interface (CLI):'''


Ensure ArangoDB is running on localhost. You may use Docker with a command as below that can be tweaked as needed to ensure it is listening locally on port 8529:
Ensure ArangoDB is running on localhost. You may use Docker with a command as below that can be tweaked as needed to ensure it is listening locally on port 8529:
  docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb
  docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb
Clone the repository, you may wish to fork it, but that's not required:
Clone the repository, you may wish to fork it, but that's not required:
Line 45: Line 45:


Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
=== The moodlenet extension package template ===
=== The moodlenet extension package template ===
You can use core MoodleNet development environment and processes to develop your packages.
You can use core MoodleNet development environment and processes to develop your packages.
Line 53: Line 52:
It is written in Javascript (EMS) instead of Typescript for a better understanding by newcomers.
It is written in Javascript (EMS) instead of Typescript for a better understanding by newcomers.


Using typescript for package development is strongly recommended, as ts-experienced-devs will take advantage of the strongly-typed framework. However this requires good typescript knowledge, and some measures and ceremonies as all MoodleNet official packages are written in Typescript.
Using typescript for package development is strongly recommended, as ts-experienced-devs will take advantage of the strongly-typed framework. However this requires good typescript knowledge, and some measures and ceremonies as all MoodleNet official packages are written in Typescript.
 
=== Install my-moodlenet-mjs-pkg-template ===
=== Install my-moodlenet-mjs-pkg-template ===
Signup using the web-app .
Signup using the web-app .
Line 61: Line 59:


Since no SMTP has been configured, the signup confirmation email supposed to be sent will be logged in the terminal:
Since no SMTP has been configured, the signup confirmation email supposed to be sent will be logged in the terminal:
 
hey {display name} confirm your email with /.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
hey {display name} confirm your email with /.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
 
Copy the url path (/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}) apply the localhost and paste it to the browser to confirm your email  
Copy the url path (/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}) apply the localhost and paste it to the browser to confirm your email  
 
localhost:8080/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
localhost:8080/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}
 
You’ll be logged in automatically and will be able to use the chosen credentials to login other times
You’ll be logged in automatically and will be able to use the chosen credentials to login other times
When logged-in, navigate to the settings page in advanced section, where you can enable "dev mode”.  
When logged-in, navigate to the settings page in advanced section, where you can enable "dev mode”.  


Line 79: Line 72:


Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
Questions? Please take a look in the [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet Community] and [https://tracker.moodle.org/projects/MDLNET/summary Tracker] for answers or to ask for help.
== Creating custom MoodleNet packages ==
== Creating custom MoodleNet packages ==
A Moodlenet package is a standard [https://nodejs.org/api/esm.html#introduction ESM] package defining a main [https://nodejs.org/api/esm.html#introduction ESM] module.
A Moodlenet package is a standard [https://nodejs.org/api/esm.html#introduction ESM] package defining a main [https://nodejs.org/api/esm.html#introduction ESM] module.
 
@moodlenet/core will import it at startup.<syntaxhighlight lang="javascript" line="1" start="1">
@moodlenet/core will import it at startup.
// package.json
// package.json
{
 
"name”: "my-moodlenet-package”,
{
"version”: "1",
 
 "type": "module",
   "name”: "my-moodlenet-package”,
"exports": {
 
  ".": "./src/server/main.mjs"
   "version”: "1",
}
 
}
  "type": "module",
</syntaxhighlight>
 
   "exports": {
 
     ".": "./src/server/main.mjs"
 
   }
 
}
===== Declare dependency =====
===== Declare dependency =====
Your MN package must declare its dependency to the @moodlenet/core package.
Your MN package must declare its dependency to the @moodlenet/core and other relevant packages package.json.
 
The core will import the main module at startup. The package "connects” to the core:<syntaxhighlight lang="javascript" line="1" start="1">
The core will import the main module at startup.
// package.json
The package "connects” to the core:
{
// package.json
   "peerDependencies”: {
 
    "@moodlenet/core”: "^0.2.0”
{
 
     "peerDependencies”: {
 
      "@moodlenet/core”: "^0.1.0”
 
   }
 
  }
  }
When adding/removing peerDependencies in the main repository based development environment, remember to execute:
}
yarn bs
</syntaxhighlight>
to link dependent packages.
=== Mono-Repository management with Lerna.js ===
// src/server/main.mjs
MoodleNet project takes leverages [https://lerna.js.org/ lerna.js] to manage multi-package mono-repository .
 
import { connectPkg } from '@moodlenet/core'
 
const connection = await connectPkg(import.meta, {
 
   apis: { }
 
})
===== Test the package template =====
* adding the template package in installation dependencies
* delete "installed” prop in the MoodleNet lock file
* restart the backend
Edit '''.dev-machines/my-dev/package.json''' adding the template package folder as dependency, similarly to other core package dependencies.
// .dev-machines/my-dev/package.json
 
{
 
   ...
 
   "dependencies”:{


     ...
Please refer to [https://lerna.js.org/ Lerna documentation] to understand how it manages mono-repo and project-packages dependency linking in the development environment.


     "my-moodlenet-mjs-pkg-template”: "file:[repofolder]/packages/my-moodlenet-mjs-pkg-template”
When you need to add or remove a dependency for your package to some MoodleNet core package you can issue
lerna add -P <needed pkg> <packages/your-pkg-dir>
e.g. lerna add -P @moodlenet/react-app packages/my-moodlenet-mjs-pkg-template


   }
You may also add/remove peerDependencies manually in package.json, in this case remember to execute:
npm run bs
From the root folder to update links to dependent packages.
=== Extend the web application ===


}
Use @moodlenet/react-app "plugin” api, during initialization to extend the web-app with a custom set of components.<syntaxhighlight lang="javascript" line="1" start="1">
===== Define and deploy APIs =====
import { pkgConnection } from '@moodlenet/core'
import reactApp from '@moodlenet/react-app'
const reactAppPkg = await pkgConnection(import.meta, reactApp)
await reactAppPkg.api('plugin')({
 mainComponentLoc:
    [‘path’, 'to', 'MainComponent.jsx']
})
</syntaxhighlight>
=== Define and deploy APIs ===
Your package will probably need to define and deploy its own APIs.
Your package will probably need to define and deploy its own APIs.


Line 182: Line 151:


  // my-moodlenet-package/1.0/hello/world
  // my-moodlenet-package/1.0/hello/world
===== Extend the web application =====
=== APIs access ===
Use @moodlenet/react-app "plugin” api, during initialization to extend the web-app with a custom set of components.
Apis can be accessed by any package running in NodeJs processes using specific @moodlenet/core functions pointing to the path of the desired API.
import { pkgConnection } from '@moodlenet/core'
 
import reactApp from '@moodlenet/react-app'
 
const reactAppPkg = await pkgConnection(import.meta, reactApp)
 
await reactAppPkg.api('plugin')({
 
  mainComponentLoc:
 
     [‘path’, 'to', 'MainComponent.jsx']
 
})
The react-app will inject your MainComponent.jsx in the web-app codebase, recompile and bundle (webpack) and serve the new extended webapp.
===== APIs access =====
Apis can be accessed by any package in system running in backend’s NodeJs process using specific @moodlenet/core functions pointing to the path of the desired API.
  // from within the backend:
  // from within the backend:


Line 219: Line 172:


    helloWorldApi(helloParam, worldParam)
    helloWorldApi(helloParam, worldParam)
===== APIs Primary Adapters =====
=== APIs Primary Adapters ===
Primary adapters implement API accessibility from external processes using some transport and protocols. Currently MoodleNet provides one Api-primary-adapter to access APIs by HTTP, which is implemented by @moodlenet/http-server. @moodlenet/http-server API HTTP adapter exposes package APIs as HTTP-POST endpoints. That endpoint is a path comprising the package name and the defined API path base, after the base API endpoint ( currently .pkgs ), having a JSON object body representing the api arguments. For example,
Primary adapters implement API accessibility from external processes using some transport and protocols. Currently MoodleNet provides one Api-primary-adapter to access APIs by HTTP, which is implemented by @moodlenet/http-server. @moodlenet/http-server API HTTP adapter exposes package APIs as HTTP-POST endpoints. That endpoint is a path comprising the package name and the defined API path base, after the base API endpoint ( currently .pkgs ), having a JSON object body representing the api arguments. For example,
  .pkgs/my-moodlenet-package/1.0/hello/world
  .pkgs/my-moodlenet-package/1.0/hello/world
Line 238: Line 191:
</blockquote>
</blockquote>
Furthermore, in the web-app, @moodlenet/react-app provides libraries to use a syntax similar to within-backend-access for easy and strongly typed API calls to the server.
Furthermore, in the web-app, @moodlenet/react-app provides libraries to use a syntax similar to within-backend-access for easy and strongly typed API calls to the server.
===== APIs Access Control =====
=== APIs Access Control ===
Packages register apis to @moodlenet/core which mediates api-call requests and responses, performing all fundamental checks and access controls.
Packages register apis to @moodlenet/core which mediates api-call requests and responses, performing all fundamental checks and access controls.
* checks requested pkg version against deployed pkg version for granting compatibility  
* checks requested pkg version against deployed pkg version for granting compatibility  
Line 246: Line 199:


* (TBD) any package can register for adding context metadata to an api call
* (TBD) any package can register for adding context metadata to an api call
===== APIs Authorization Scopes (TBD) =====
=== APIs Authorization Scopes (TBD) ===
The core will export functions to define package-specific auth-scopes - similar to OAuth specs.
The core will export functions to define package-specific auth-scopes - similar to OAuth specs.


Line 272: Line 225:
* [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet news and discussion]
* [https://moodle.org/mod/forum/view.php?id=8726 MoodleNet news and discussion]
* [https://tracker.moodle.org/secure/RapidBoard.jspa?rapidView=167&view=detail MoodleNet Issue Tracker]
* [https://tracker.moodle.org/secure/RapidBoard.jspa?rapidView=167&view=detail MoodleNet Issue Tracker]
* [https://gitlab.com/moodlenet/moodlenet/-/issues MoodleNet Gitlab Issues]
[[es:MoodleNet]]
[[es:MoodleNet]]

Revision as of 09:39, 7 December 2022

Moodlenet-logo.png

What is MoodleNet?

MoodleNet is a flexible Open Education Technology platform for curating collections of the best known Open Educational (and other) Resources. You'll find more general information in the MoodleNet user documentation.

If you are looking to get started as a MoodleNet developer, we recommend taking the MoodleNet for Developers course with Moodle Academy.

Current status

Take a look at MoodleNet releases in our Tracker.

Roadmap

MoodleNet architecture

MoodleNet is a full stack TypeScript/JavaScript system using:

  • NodeJs
    • NPM Packages [1]
    • ESM Modules [2]
  • Browsers

MoodleNet development environment

Setup development environment

From the command line interface (CLI):

Ensure ArangoDB is running on localhost. You may use Docker with a command as below that can be tweaked as needed to ensure it is listening locally on port 8529:

docker run -e ARANGO_NO_AUTH=1 -p 8529:8529 --rm --name=mn3arango arangodb

Clone the repository, you may wish to fork it, but that's not required:

git clone https://gitlab.com/moodlenet/moodlenet.git

Change to the project's folder:

cd moodlenet

Install and initialize the project:

npm install

Install a development deployment:

npm run dev-install-backend [install dir name]

We have used "my-dev" as [install dir name] in the following instructions.

You’ll find the newly created dev-installation in .dev-machines/my-dev and can create as many dev installations as you wish.

Run development backend:

npm run dev-start-backend my-dev

The first run of the system takes some time to install.

Once installed, browse http://localhost:8080

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

The moodlenet extension package template

You can use core MoodleNet development environment and processes to develop your packages.

We recommend to start understanding the extension framework tweaking the template package “my-moodlenet-mjs-pkg-template” you’ll find it in the folder “packages”.

It is written in Javascript (EMS) instead of Typescript for a better understanding by newcomers.

Using typescript for package development is strongly recommended, as ts-experienced-devs will take advantage of the strongly-typed framework. However this requires good typescript knowledge, and some measures and ceremonies as all MoodleNet official packages are written in Typescript.

Install my-moodlenet-mjs-pkg-template

Signup using the web-app .

Note: Do not use sensible passwords as the system saves the email-password credentials unencrypted in the database.

Since no SMTP has been configured, the signup confirmation email supposed to be sent will be logged in the terminal:

hey {display name} confirm your email with /.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}

Copy the url path (/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}) apply the localhost and paste it to the browser to confirm your email

localhost:8080/.pkg/@moodlenet/simple-email-auth/confirm-email/{LONG_HASH}

You’ll be logged in automatically and will be able to use the chosen credentials to login other times When logged-in, navigate to the settings page in advanced section, where you can enable "dev mode”.

Then proceed to extensions / install extension section and submit the package absolute path to your package local folder.

The system will install the package and restart.

It will take some time to rebuild the web-app to see the results

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

Creating custom MoodleNet packages

A Moodlenet package is a standard ESM package defining a main ESM module.

@moodlenet/core will import it at startup.

// package.json
{
"name”: "my-moodlenet-package,
"version”: "1",
 "type": "module",
"exports": {
  ".": "./src/server/main.mjs"
}
}
Declare dependency

Your MN package must declare its dependency to the @moodlenet/core and other relevant packages package.json.

The core will import the main module at startup. The package "connects” to the core:

// package.json
{
  "peerDependencies”: {
    "@moodlenet/core: "^0.2.0
 }
}

Mono-Repository management with Lerna.js

MoodleNet project takes leverages lerna.js to manage multi-package mono-repository .

Please refer to Lerna documentation to understand how it manages mono-repo and project-packages dependency linking in the development environment.

When you need to add or remove a dependency for your package to some MoodleNet core package you can issue

lerna add -P <needed pkg> <packages/your-pkg-dir>

e.g. lerna add -P @moodlenet/react-app packages/my-moodlenet-mjs-pkg-template

You may also add/remove peerDependencies manually in package.json, in this case remember to execute:

npm run bs

From the root folder to update links to dependent packages.

Extend the web application

Use @moodlenet/react-app "plugin” api, during initialization to extend the web-app with a custom set of components.

import { pkgConnection } from '@moodlenet/core'
import reactApp from '@moodlenet/react-app'
const reactAppPkg = await pkgConnection(import.meta, reactApp)
await reactAppPkg.api('plugin')({
 mainComponentLoc:
    [path, 'to', 'MainComponent.jsx']
})

Define and deploy APIs

Your package will probably need to define and deploy its own APIs.

APIs are simply a collection of async functions - along with a params formal validation function - organized in a structured Js object.

APIs will be registered in the system with a path-like string, having your package name as prefix and apth following api structure.

// src/server/main.mjs
import { connectPkg, defApi } from '@moodlenet/core'
const myApis = {
  hello:{
     world: defApi( ctx => 
        async (p1,p2) => { return // something } , 
       (...params) => { /* … validate params */ }
  )
}
const connection = await connectPkg(import.meta, { 
  apis: myApis 
})
// will register 1 api: 
// my-moodlenet-package/1.0/hello/world

APIs access

Apis can be accessed by any package running in NodeJs processes using specific @moodlenet/core functions pointing to the path of the desired API.

// from within the backend:
// locate an package api by path
import myMNPkgConn from
   ‘my-moodlenet-package’
const myMNPkg = await pkgConnection(import.meta, myMNPkgConn)
const helloWorldApi =
  myMNPkg.api(‘hello/world’)
// call api as an async function
const result = await
  helloWorldApi(helloParam, worldParam)

APIs Primary Adapters

Primary adapters implement API accessibility from external processes using some transport and protocols. Currently MoodleNet provides one Api-primary-adapter to access APIs by HTTP, which is implemented by @moodlenet/http-server. @moodlenet/http-server API HTTP adapter exposes package APIs as HTTP-POST endpoints. That endpoint is a path comprising the package name and the defined API path base, after the base API endpoint ( currently .pkgs ), having a JSON object body representing the api arguments. For example,

.pkgs/my-moodlenet-package/1.0/hello/world

body:

{

 "args” : [

   "hello-param1”,

   "world-param2”

 ]

}

Furthermore, in the web-app, @moodlenet/react-app provides libraries to use a syntax similar to within-backend-access for easy and strongly typed API calls to the server.

APIs Access Control

Packages register apis to @moodlenet/core which mediates api-call requests and responses, performing all fundamental checks and access controls.

  • checks requested pkg version against deployed pkg version for granting compatibility
  • calls api’s params formal validation function before forwarding to actual api function
  • (TBD) checks matching of scopes associated with api and caller (user or package)
  • provides the api a call-context holding an extensible set of metadata (e.g. user session, caller pkg … )
  • (TBD) any package can register for adding context metadata to an api call

APIs Authorization Scopes (TBD)

The core will export functions to define package-specific auth-scopes - similar to OAuth specs.

defApi() will provide options to apply own or other-pkg’s auth-scopes to api.

All Api accesses will be authorized at core level checking scopes assigned to api against scopes assigned to caller. Note that the caller may be a user using some primary adapter e.g. HTTP or can be simply another package, on its behalf, from within the system.

Packages will have to declare which scopes they will need to be granted in order to perform their functionalities.

Package scope-dependencies should be granted by the admin at installation time in order to complete the installation - similar to what happens on smartphones.

Testing MoodleNet packages

Once we’re happy with package development on dev-environment, we can try to install it on a real MoodleNet installation, using the admin UI.

Installation of MoodleNet in a production-like environment is a one liner cmd:

npx install \ @moodlenet/create \ dest/folder

Ensure ArangoDB is running and once inside the "dest/folder" installation directory:

npx @moodlenet/core

Create a user and navigate to the settings page where you can enable "dev mode”. Then proceed to extensions/install section and submit the package absolute path to local folder.

Questions? Please take a look in the MoodleNet Community and Tracker for answers or to ask for help.

Important links