2017-11-30 19:30:19 +01:00
|
|
|
# This — is The **Construct**
|
2015-02-25 03:32:08 +01:00
|
|
|
|
2018-01-10 10:19:04 +01:00
|
|
|
<img align="right" src="https://i.imgur.com/TIf8kEC.png" />
|
2017-10-16 06:12:18 +02:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
#### Internet Relay Chat daemon: *Matrix Construct*
|
2016-01-23 20:52:57 +01:00
|
|
|
|
2017-12-23 04:46:57 +01:00
|
|
|
IRCd was a free and open source server which facilitated real-time communication over the
|
2017-11-05 06:14:33 +01:00
|
|
|
internet. It was started by Jarkko Oikarinen in 1988 at the University of Oulu and [its
|
2017-10-25 18:24:50 +02:00
|
|
|
derivatives](https://upload.wikimedia.org/wikipedia/commons/d/d8/IRCd_software_implementations.png)
|
2017-11-30 19:30:19 +01:00
|
|
|
underpinned the major IRC networks for decades.
|
2017-09-09 14:50:16 +02:00
|
|
|
|
2017-12-23 04:46:57 +01:00
|
|
|
Due to its age and stagnation since the mid-2000's, a growing number of proprietary cloud services
|
|
|
|
are now filling the vacuum of innovation. In 2014 a new approach was proposed to reinvigorate
|
2018-01-18 15:03:59 +01:00
|
|
|
real-time communication for free and open source software: a *federation of networks* known as
|
2018-01-07 06:37:29 +01:00
|
|
|
*the matrix*.
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2018-04-26 03:49:58 +02:00
|
|
|
<h4 align="right">
|
|
|
|
IRCd has been rewritten for the global federation of networks  
|
|
|
|
</h4>
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2018-04-29 03:47:54 +02:00
|
|
|
<img align="right" src="https://i.imgur.com/DUuGSrH.png" />
|
2018-04-21 12:24:50 +02:00
|
|
|
|
2017-12-25 06:41:13 +01:00
|
|
|
**This is the Construct** — the first Matrix server written in C++. It is designed to be
|
|
|
|
fast and highly scalable, and to be community developed by volunteer contributors over
|
|
|
|
the internet. This mission strives to make the software easy to understand, modify, audit,
|
|
|
|
and extend. It remains true to its roots with its modular design and having minimal
|
2018-05-17 01:34:58 +02:00
|
|
|
requirements.
|
|
|
|
|
|
|
|
Even though all of the old code has been rewritten, the same spirit and
|
2017-12-25 06:41:13 +01:00
|
|
|
_philosophy of its predecessors_ is still obvious throughout.
|
2017-09-26 23:10:02 +02:00
|
|
|
|
2018-04-26 03:49:58 +02:00
|
|
|
Similar to the legacy IRC protocol's origins, Matrix wisely leverages technologies in vogue
|
|
|
|
for its day to aid the virility of implementations. A vibrant and growing ecosystem
|
|
|
|
[already exists](https://matrix.org/docs/projects/try-matrix-now.html).
|
|
|
|
|
2018-05-02 21:34:59 +02:00
|
|
|
|
2017-09-26 23:10:02 +02:00
|
|
|
#### Dependencies
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2018-04-26 03:49:58 +02:00
|
|
|
- **Boost** (1.66 or later)
|
2017-12-23 04:46:57 +01:00
|
|
|
Replacing libratbox with the rich and actively developed libraries.
|
|
|
|
|
|
|
|
- **RocksDB** (based on LevelDB):
|
|
|
|
A lightweight and embedded database superseding sqlite3.
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2017-12-23 04:46:57 +01:00
|
|
|
- **Sodium** (NaCl crypto):
|
|
|
|
Provides ed25519 required for the Matrix Federation.
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2017-12-23 04:46:57 +01:00
|
|
|
- **OpenSSL** (libssl/libcrypto):
|
|
|
|
Provides HTTPS TLS / X.509 / etc.
|
2017-10-01 04:14:45 +02:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- **GNU C++ compiler**, **automake**, **autoconf**, **autoconf2.13**,
|
|
|
|
**autoconf-archive**, **libtool**, **shtool**
|
2017-12-23 04:46:57 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
##### Additional dependencies
|
2017-12-25 06:41:13 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- **libmagic** (~Optional~):
|
2018-02-18 04:48:36 +01:00
|
|
|
Content MIME type recognition.
|
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- **zlib** or **lz4** or **snappy** (Optional):
|
|
|
|
Provides compression for the database, etc.
|
2017-09-23 07:19:47 +02:00
|
|
|
|
2017-12-02 22:14:30 +01:00
|
|
|
*Notes*:
|
|
|
|
- libircd requires a platform capable of loading dynamic shared objects at runtime.
|
|
|
|
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
#### Platforms
|
|
|
|
|
2018-05-17 01:34:58 +02:00
|
|
|
[![Construct](https://img.shields.io/SemVer/v0.0.0-dev.png)](https://github.com/jevolk/charybdis/tree/master)
|
2015-02-25 03:32:08 +01:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
| <sub> Continuously Integrated Host </sub> | <sub> Compiler </sub> | <sub> Third party </sub> | <sub> Status </sub> |
|
|
|
|
|:------------------------------------------- |:------------------------ |:------------------------ |:------------------- |
|
2018-05-17 01:34:58 +02:00
|
|
|
| <sub> Linux Ubuntu 16.04 Xenial </sub> | <sub> GCC 6 </sub> | <sub> Boost 1.66 </sub> | [![POSIX Build Status](https://travis-ci.org/jevolk/charybdis.svg?branch=master)](https://travis-ci.org/jevolk/charybdis) |
|
2017-09-23 07:19:47 +02:00
|
|
|
|
2017-08-18 00:33:22 +02:00
|
|
|
|
2018-05-17 01:34:58 +02:00
|
|
|
## Installation
|
|
|
|
|
|
|
|
<a href="https://github.com/tulir/gomuks">
|
2018-07-01 11:45:22 +02:00
|
|
|
<img align="right" src="https://i.imgur.com/YMUAULE.png" />
|
2018-05-17 01:34:58 +02:00
|
|
|
</a>
|
|
|
|
|
2018-09-04 07:03:32 +02:00
|
|
|
### BUILD
|
2018-08-25 23:33:30 +02:00
|
|
|
|
|
|
|
*Please follow the standalone build instructions in the next section until this
|
|
|
|
notice is removed.*
|
2017-09-09 14:50:16 +02:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
```
|
|
|
|
./autogen.sh
|
|
|
|
./configure
|
|
|
|
make
|
|
|
|
sudo make install
|
|
|
|
```
|
2017-09-23 07:19:47 +02:00
|
|
|
|
2018-09-04 07:03:32 +02:00
|
|
|
### BUILD (standalone)
|
2017-09-09 14:50:16 +02:00
|
|
|
|
2018-05-27 12:14:45 +02:00
|
|
|
*Intended to allow building with dependencies that have not made their way
|
|
|
|
to mainstream systems.*
|
2017-09-23 07:19:47 +02:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
```
|
|
|
|
./autogen.sh
|
|
|
|
mkdir build
|
|
|
|
```
|
|
|
|
|
2017-09-23 07:19:47 +02:00
|
|
|
- The install directory may be this or another place of your choosing.
|
|
|
|
- If you decide elsewhere, make sure to change the `--prefix` in the `./configure`
|
|
|
|
statement below.
|
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
```
|
2018-08-25 23:30:55 +02:00
|
|
|
CXX=g++-6 ./configure --prefix=$PWD/build --with-included-boost --with-included-rocksdb
|
2017-11-30 19:30:19 +01:00
|
|
|
```
|
|
|
|
|
2017-09-23 07:19:47 +02:00
|
|
|
- Many systems alias `g++` to an older version. To be safe, specify a version manually
|
|
|
|
in `CXX`. This will also build the submodule dependencies with that version.
|
|
|
|
- The `--with-included-*` will fetch, configure **and build** the dependencies included
|
2018-08-25 23:30:55 +02:00
|
|
|
as submodules.
|
2017-09-23 07:19:47 +02:00
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
```
|
|
|
|
make install
|
|
|
|
```
|
2016-03-23 21:10:44 +01:00
|
|
|
|
2018-09-04 07:03:32 +02:00
|
|
|
### SETUP
|
|
|
|
|
|
|
|
- For standalone builds you will need to add the `deps/boost/lib` directory
|
|
|
|
in your git repo to the library path:
|
|
|
|
`export LD_LIBRARY_PATH=/path/to/src/deps/boost/lib:$LD_LIBRARY_PATH`
|
|
|
|
|
|
|
|
- To ease these instructions we will refer to your server as `host.tld`. For
|
|
|
|
those familiar with matrix: this is your origin and mxid `@user:host.tld`
|
|
|
|
hostpart. If your DNS uses `matrix.host.tld` that subdomain is not involved
|
|
|
|
when we refer to `host.tld` unless we explicitly mention to involve it.
|
|
|
|
|
|
|
|
|
|
|
|
1. Execute
|
|
|
|
```
|
|
|
|
bin/construct host.tld
|
|
|
|
````
|
|
|
|
> There is no configuration file.
|
|
|
|
|
|
|
|
> Log messages will appear in terminal concluding with notice `IRCd RUN`.
|
|
|
|
|
|
|
|
|
|
|
|
2. Strike ctrl-c on keyboard
|
|
|
|
> The command-line console will appear.
|
|
|
|
|
|
|
|
|
|
|
|
3. Create a general listener socket by entering the following command:
|
|
|
|
- If you have existing TLS certificates, replace those parts of the
|
|
|
|
command with paths to your certificate and key, respectively. If you
|
|
|
|
do not, those files will be created and self-signed in the current
|
|
|
|
directory; another target path may be specified.
|
|
|
|
|
|
|
|
```
|
|
|
|
net listen matrix 0.0.0.0 8448 host.tld.crt host.tld.crt.key
|
|
|
|
```
|
|
|
|
|
|
|
|
> The Matrix Federation Tester should now pass. Browse to
|
|
|
|
https://matrix.org/federationtester/api/report?server_name=host.tld and
|
|
|
|
verify `"AllChecksOK": true`
|
|
|
|
|
|
|
|
4. Relax restrictions for self-signed certificates.
|
|
|
|
- Due to the current nature of the federation and the number of
|
|
|
|
unsophisticated personal deployments we have little choice but to
|
|
|
|
advise this step. We cannot, in good faith, ship this software
|
|
|
|
configured insecurely by default; therefor we leave this step to
|
|
|
|
you.
|
|
|
|
|
|
|
|
```
|
|
|
|
conf set ircd.net.open.allow_self_signed true
|
|
|
|
```
|
|
|
|
|
|
|
|
5. To use a web-based client like Riot, configure the "webroot" directory
|
|
|
|
to point at Riot's `webapp/` directory by entering the following:
|
|
|
|
```
|
|
|
|
conf set ircd.webroot.path /path/to/riot-web/webapp/
|
|
|
|
mod reload webroot
|
|
|
|
```
|
|
|
|
|
|
|
|
6. Browse to `https://host.tld:8448/` and register a user.
|
|
|
|
|
|
|
|
|
|
|
|
## Addendum
|
|
|
|
|
|
|
|
#### Additional build options
|
2018-05-27 12:14:45 +02:00
|
|
|
|
|
|
|
Development builds should follow the same instructions as the standalone
|
|
|
|
section above while taking note of the following `./configure` options:
|
|
|
|
|
|
|
|
##### Debug mode
|
|
|
|
|
|
|
|
```
|
|
|
|
--enable-debug
|
|
|
|
```
|
|
|
|
Full debug mode. Includes additional code within `#ifdef RB_DEBUG` sections.
|
|
|
|
Optimization level is `-Og`, which is still valgrind-worthy. Debugger support
|
|
|
|
is `-ggdb`. Log level is `DEBUG` (maximum). Assertions are enabled.
|
|
|
|
|
|
|
|
|
2018-08-25 23:33:30 +02:00
|
|
|
##### Release modes (for distribution packages)
|
|
|
|
|
|
|
|
Options in this section may help distribution maintainers create packages.
|
|
|
|
Users building for themselves (whether standalone or fully installed) probably
|
|
|
|
don't need anything here.
|
|
|
|
|
|
|
|
```
|
|
|
|
--enable-generic
|
|
|
|
```
|
|
|
|
Sets `-mtune=generic` as `native` is otherwise the default.
|
|
|
|
|
|
|
|
|
2018-05-27 12:14:45 +02:00
|
|
|
##### Manually enable assertions
|
|
|
|
|
|
|
|
```
|
|
|
|
--enable-assert
|
|
|
|
```
|
|
|
|
Implied by `--enable-debug`. This is useful to specifically enable `assert()`
|
|
|
|
statements when `--enable-debug` is not used.
|
|
|
|
|
|
|
|
|
|
|
|
##### Manually enable optimization
|
|
|
|
|
|
|
|
```
|
|
|
|
--enable-optimize
|
|
|
|
```
|
|
|
|
This manually applies full release-mode optimizations even when using
|
|
|
|
`--enable-debug`. Implied when not in debug mode.
|
|
|
|
|
|
|
|
|
|
|
|
##### Logging level
|
|
|
|
|
|
|
|
```
|
|
|
|
--with-log-level=
|
|
|
|
```
|
|
|
|
This manually sets the level of logging. All log levels at or below this level
|
|
|
|
will be available. When a log level is not available, all code used to generate
|
|
|
|
its messages will be entirely eliminated via *dead-code-elimination* at compile
|
|
|
|
time.
|
|
|
|
|
|
|
|
The log levels are (from logger.h):
|
|
|
|
```
|
|
|
|
7 DEBUG Maximum verbosity for developers.
|
|
|
|
6 DWARNING A warning but only for developers (more frequent than WARNING).
|
|
|
|
5 DERROR An error but only worthy of developers (more frequent than ERROR).
|
|
|
|
4 INFO A more frequent message with good news.
|
|
|
|
3 NOTICE An infrequent important message with neutral or positive news.
|
|
|
|
2 WARNING Non-impacting undesirable behavior user should know about.
|
|
|
|
1 ERROR Things that shouldn't happen; user impacted and should know.
|
|
|
|
0 CRITICAL Catastrophic/unrecoverable; program is in a compromised state.
|
|
|
|
```
|
|
|
|
|
|
|
|
When `--enable-debug` is used `--with-log-level=DEBUG` is implied. Otherwise
|
|
|
|
for release mode `--with-log-level=INFO` is implied. Large deployments with
|
|
|
|
many users may consider lower than `INFO` to maximize optimization and reduce
|
|
|
|
noise.
|
|
|
|
|
|
|
|
|
2017-11-30 19:30:19 +01:00
|
|
|
## Developers
|
2015-02-25 03:32:08 +01:00
|
|
|
|
2018-05-22 13:16:45 +02:00
|
|
|
<a href="https://github.com/mujx/nheko">
|
|
|
|
<img align="right" src="https://i.imgur.com/GQ91GOK.png" />
|
2018-05-27 12:14:45 +02:00
|
|
|
<br />
|
2018-05-22 13:16:45 +02:00
|
|
|
</a>
|
|
|
|
|
2017-12-12 22:58:10 +01:00
|
|
|
[![](https://img.shields.io/badge/License-BSD-brightgreen.svg)]() [![](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat-square)]()
|
|
|
|
|
2018-05-24 01:28:47 +02:00
|
|
|
Generate doxygen using `/usr/bin/doxygen tools/doxygen.conf` the target
|
|
|
|
directory is `doc/html`. Browse to `doc/html/index.html`.
|
2016-03-06 00:49:13 +01:00
|
|
|
|
2018-01-18 15:03:59 +01:00
|
|
|
## Plan
|
|
|
|
|
|
|
|
#### Roadmap for service
|
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- [x] **Phase One**: Matrix clients using HTTPS.
|
2018-05-24 01:28:47 +02:00
|
|
|
- [ ] **Phase Two**: Legacy IRC network TS6 protocol.
|
2018-04-21 12:24:50 +02:00
|
|
|
- [ ] **Phase Three**: Legacy IRC clients using RFC1459 / RFC2812 legacy grammars.
|
2018-01-18 15:03:59 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
#### Roadmap for deployments
|
2017-12-25 06:41:13 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
The deployment mode is a macro of configuration variables which tune the daemon
|
|
|
|
for how it is being used. Modes mostly affect aspects of local clients.
|
2017-12-25 06:41:13 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- [x] **Personal**: One or few users. Few default restrictions; higher log output.
|
|
|
|
- [ ] **Company**: Hundreds of users. Moderate default restrictions.
|
|
|
|
- [ ] **Public**: Thousands of users. Untrusting configuration defaults.
|
2017-12-25 06:41:13 +01:00
|
|
|
|
2018-01-18 15:03:59 +01:00
|
|
|
#### Roadmap for innovation
|
2017-12-25 06:41:13 +01:00
|
|
|
|
2018-04-21 12:24:50 +02:00
|
|
|
- [x] Phase Zero: **Core libircd**: Utils; Modules; Contexts; JSON; Database; HTTP; etc...
|
|
|
|
- [x] Phase One: **Matrix Protocol**: Core VM; Core modules; Protocol endpoints; etc...
|
|
|
|
- [ ] Phase Two: **Construct Cluster**: Kademlia sharding of events; Maymounkov's erasure codes.
|