Go to file
joeduffy 162157c1a7 Add a Dockerfile for the Pulumi CLI
This introduces a Dockerfile for the Pulumi CLI. This makes it
easier to develop and test the engine in a self-contained environment,
in addition to being suitable for running the actual CLI itself.

For instance,

    $ docker run pulumi/pulumi -e "PULUMI_ACCESS_TOKEN=x" up

will run the Pulumi program mounted under the /app volume. This will
be used in some upcoming CI/CD scenarios.

This uses multi-stage builds, and Debian Stretch as the base, for
relatively fast and lean build times and resulting images. We are
intentional about restoring dep packages independent of the actual
source code so that we don't end up needlessly re-depping, which can
consume quite a bit of time. After fixing
https://github.com/pulumi/pulumi/issues/1986, we should explore an
Alpine base image option.

I made the decision to keep this image scoped to just the Go builds.
Therefore, none of the actual SDK packages themselves are built, just
the engine, CLI, and language plugins for Node.js, Python, and Go.
It's possible to create a mega-container that has all of these full
environments so that we can rebuild them too, but for now I figured
it was better to rely on package management for them.

Another alternative would have been to install released binaries,
rather than building them. To keep the useful flow for development,
however, I decided to go the build route for now. If we build at the
same hashes, the resulting binaries "should" be ~identical anyhow.

I've created a pulumi/pulumi Docker Hub repo that we can publish this
into. For now, there is no CI publishing of the image.

This fixes pulumi/pulumi#1991.
2018-09-29 11:48:21 -07:00
build Merge pull request #1698 from pulumi/ellismg/fix-1581 2018-08-08 14:16:20 -07:00
cmd Move interactive checking into pkg/util/cmdutil 2018-09-29 10:49:14 -07:00
examples Delete a dead example (#1996) 2018-09-28 12:10:50 -07:00
pkg Reject logins for non-interactive when envvar is unset 2018-09-29 10:55:19 -07:00
scripts Restore build-sdk.sh script 2018-09-26 21:49:19 -07:00
sdk Add a Dockerfile for the Pulumi CLI 2018-09-29 11:48:21 -07:00
tests Enable stack outputs to be JSON formatted (#2000) 2018-09-29 09:57:58 -07:00
.appveyor.yml Update ssh-agent dependency for compat with go 1.11 2018-08-29 18:28:55 -07:00
.dockerignore Add a Dockerfile for the Pulumi CLI 2018-09-29 11:48:21 -07:00
.gitignore Support TypeScript in a more first-class way 2018-08-06 14:00:58 -07:00
.travis.yml Go back to capturing *non-user* modules by 'require' reference. (#1655) 2018-07-31 11:37:46 -04:00
.yarnrc Pass --network-concurrency 1 to yarn 2018-01-29 11:49:42 -08:00
build.proj Bump windows test timeout 2018-06-25 17:31:31 -07:00
CODE-OF-CONDUCT.md Adopt Contributor Covenant code of conduct 2018-05-30 11:01:52 -07:00
CONTRIBUTING.md Added brew install instructions for macOS 2018-08-01 14:32:09 -07:00
Dockerfile Add a Dockerfile for the Pulumi CLI 2018-09-29 11:48:21 -07:00
Gometalinter.json Add additional linting (#768) 2017-12-27 17:10:12 -08:00
Gopkg.lock Use go-humanize instead of lame hand-pluralization 2018-09-24 14:40:14 -07:00
Gopkg.toml Fix wierd interactions due to Cobra and glog 2018-08-20 14:08:40 -07:00
LICENSE Relicense under Apache 2.0 2018-05-22 13:52:41 -07:00
main.go Fix main.go copyright header 2018-05-31 08:35:39 -07:00
Makefile Added dist target for make, will help with Homebrew (#1731) 2018-08-08 13:00:42 -07:00
README.md Add link to full installation instructions (#1994) 2018-09-28 07:03:28 -07:00
tslint.json Enable 'use const' linter rule. (#405) 2017-10-10 14:50:55 -07:00

Slack NPM version Python version GoDoc License

The Pulumi Cloud Native Development Platform is the easiest way to create and deploy cloud programs that use containers, serverless functions, hosted services, and infrastructure, on any cloud.

Simply write code in your favorite language and Pulumi automatically provisions and manages your AWS, Azure, Google Cloud Platform, and/or Kubernetes resources, using an infrastructure-as-code approach. Skip the YAML, and use standard language features like loops, functions, classes, and package management that you already know and love.

For example, create three web servers:

let aws = require("@pulumi/aws");
let sg = new aws.ec2.SecurityGroup("web-sg", {
    ingress: [{ protocol: "tcp", fromPort: 80, toPort: 80, cidrBlocks: ["0.0.0.0/0"]}],
});
for (let i = 0; i < 3; i++) {
    new aws.ec2.Instance(`web-${i}`, {
        ami: "ami-7172b611",
        instanceType: "t2.micro",
        securityGroups: [ sg.name ],
        userData: `#!/bin/bash
            echo "Hello, World!" > index.html
            nohup python -m SimpleHTTPServer 80 &`,
    });
}

Or a simple serverless timer that archives Hacker News every day at 8:30AM:

let cloud = require("@pulumi/cloud");
let snapshots = new cloud.Table("snapshots");
cloud.timer.daily("daily-yc-snapshot", { hourUTC: 8, minuteUTC: 30 }, () => {
    let req = require("https").get("https://news.ycombinator.com", (res) => {
        let content = "";
        res.setEncoding("utf8");
        res.on("data", (chunk) => { content += chunk });
        res.on("end", () => {
           snapshots.insert({ date: Date.now(), content: content });
        });
    });
    req.end();
});

Many examples are available spanning containers, serverless, and infrastructure in pulumi/examples.

Pulumi is open source under the Apache 2.0 license, supports many languages and clouds, and is easy to extend. This repo contains the pulumi CLI, language SDKs, and core Pulumi engine, and individual libraries are in their own repos.

Welcome

  • Getting Started: get up and running quickly.

  • Tutorials: walk through end-to-end workflows for creating containers, serverless functions, and other cloud services and infrastructure.

  • Examples: browse a number of useful examples across many languages, clouds, and scenarios including containers, serverless, and infrastructure.

  • A Tour of Pulumi: interactively walk through the core Pulumi concepts, one at a time, covering the entire CLI and programming model surface area in a handful of bite-sized chunks.

  • Reference Docs: read conceptual documentation, in addition to details on how to configure Pulumi to deploy into your AWS, Azure, or Google Cloud accounts, and/or Kubernetes cluster.

  • Community Slack: join us over at our community Slack channel. Any and all discussion or questions are welcome.

Getting Started

Follow these steps to deploy your first Pulumi program, using AWS Serverless Lambdas, in minutes:

  1. Install:

    To install the latest Pulumi release, run the following (see full installation instructions for additional installation options):

    $ curl -fsSL https://get.pulumi.com/ | sh
    
  2. Configure your Cloud Provider so that Pulumi can deploy into it.

  3. Create a Project:

    After installing, you can get started with the pulumi new command:

    $ pulumi new hello-aws-javascript
    

    The new command offers templates for all languages and clouds. Run it without an argument and it'll prompt you with available projects. This command created an AWS Serverless Lambda project written in JavaScript.

  4. Deploy to the Cloud:

    Run pulumi update to get your code to the cloud:

    $ pulumi update
    

    This makes all cloud resources needed to run your code. Simply make edits to your project, and subsequent pulumi updates will compute the minimal diff to deploy your changes.

  5. Use Your Program:

    Now that your code is deployed, you can interact with it. In the above example, we can curl the endpoint:

    $ curl $(pulumi stack output url)
    
  6. Access the Logs:

    If you're using containers or functions, Pulumi's unified logging command will show all of your logs:

    $ pulumi logs -f
    
  7. Destroy your Resources:

    After you're done, you can remove all resources created by your program:

    $ pulumi destroy -y
    

Please head on over to the project website for much more information, including tutorials, examples, and an interactive tour of the core Pulumi CLI and programming model concepts.

Platform

CLI

Architecture Build Status
Linux/macOS x64 Linux x64 Build Status
Windows x64 Windows x64 Build Status

Languages

Language Status Runtime
JavaScript Stable Node.js 6.x-10.x
TypeScript Stable Node.js 6.x-10.x
Python Preview Python 2.7
Go Preview Go 1.x

Clouds

Cloud Status Docs
Amazon Web Services Stable Docs
Microsoft Azure Preview Docs
Google Cloud Platform Preview Docs
Kubernetes Preview Docs

Libraries

There are several libraries that encapsulate best practices and common patterns:

Library Status Docs Repo
AWS Serverless Preview Docs pulumi/pulumi-aws-serverless
AWS Infrastructure Preview Docs pulumi/pulumi-aws-infra
Pulumi Multi-Cloud Framework Preview Docs pulumi/pulumi-cloud

Development

If you'd like to contribute to Pulumi and/or build from source, this section is for you.

Prerequisites

Pulumi is written in Go, uses Dep for dependency management, and GoMetaLinter for linting:

Building and Testing

To install the pre-built SDK, please run curl -fsSL https://get.pulumi.com/ | sh, or see detailed installation instructions on the project page. Read on if you want to install from source.

To build a complete Pulumi SDK, ensure $GOPATH is set, and clone into a standard Go workspace:

$ git clone git@github.com:pulumi/pulumi $GOPATH/src/github.com/pulumi/pulumi
$ cd $GOPATH/src/github.com/pulumi/pulumi

The first time you build, you must make ensure to install dependencies and perform other machine setup:

$ make ensure

In the future, you can synch dependencies simply by running dep ensure explicitly:

$ dep ensure

At this point you can run make to build and run tests:

$ make

This installs the pulumi binary into $GOPATH/bin, which may now be run provided make exited successfully.

The Makefile also supports just running tests (make test_all or make test_fast), just running the linter (make lint), just running Govet (make vet), and so on. Please just refer to the Makefile for the full list of targets.

Debugging

The Pulumi tools have extensive logging built in. In fact, we encourage liberal logging in new code, and adding new logging when debugging problems. This helps to ensure future debugging endeavors benefit from your sleuthing.

All logging is done using Google's Glog library. It is relatively bare-bones, and adds basic leveled logging, stack dumping, and other capabilities beyond what Go's built-in logging routines offer.

The pulumi command line has two flags that control this logging and that can come in handy when debugging problems. The --logtostderr flag spews directly to stderr, rather than the default of logging to files in your temp directory. And the --verbose=n flag (-v=n for short) sets the logging level to n. Anything greater than 3 is reserved for debug-level logging, greater than 5 is going to be quite verbose, and anything beyond 7 is extremely noisy.

For example, the command

$ pulumi preview --logtostderr -v=5

is a pretty standard starting point during debugging that will show a fairly comprehensive trace log of a compilation.