yyforyongyu d9498a9d13 lntest: increase DefaultTimeout for postgres 3 months ago
..
channels f8b98a1d3b lntest/channels: introduce subpackage to deduplicate static structs 3 years ago
mock ab7634b276 multi: Add utxo restriction for batchchannel openings. 4 months ago
node dc4ec45423 itest: add more tests related to inbound fees 4 months ago
port 9cd7285439 itest+lntest: use system wide unique ports everywhere 6 months ago
rpc 3364d2f2d6 lntest: delete all payments in `DeleteAllPayments` 4 months ago
unittest d40312c36b multi: move unit test backend funcs to new package 6 months ago
wait d9498a9d13 lntest: increase DefaultTimeout for postgres 3 months ago
README.md 089278d817 docs+lntest: fix typos 6 months ago
bitcoind.go e789107e1f multi: new bitcoind rpcpolling backend for itests 2 years ago
bitcoind_common.go df4ddcc573 multi: replace ioutil.TempDir 4 months ago
bitcoind_notxindex.go e789107e1f multi: new bitcoind rpcpolling backend for itests 2 years ago
bitcoind_rpcpolling.go e789107e1f multi: new bitcoind rpcpolling backend for itests 2 years ago
btcd.go caf2419ff6 multi: replace ioutil.ReadDir 4 months ago
doc.go 77d5f21b54 lntest: Add doc.go with package documentation. 6 years ago
fee_service.go 3837c3f12e lnwallet: add configurable cache for web fee estimator 4 months ago
harness.go 55452f64e8 lntest: wait for mempool update after mining txns 3 months ago
harness_assertion.go d854c80aa7 itest+lntest: fix itest re the new sweeping behavior 5 months ago
harness_miner.go caf2419ff6 multi: replace ioutil.ReadDir 4 months ago
harness_node_manager.go ba8e7550d5 itest: add the -nativesql flag to run SQL itests with native SQL tables 6 months ago
harness_setup.go ab422ba184 lntest: give chain backend more time to get ready 6 months ago
neutrino.go 9d1d629001 itest+lntest: migrate `lntemp` to `lntest` 1 year ago
utils.go 8da68bb7db multi: apply the new type `lntypes.WeightUnit` 3 months ago

README.md

lntest

lntest is a package which holds the components used for the lnd’s integration tests. It is responsible for managing lnd nodes, chain backends and miners, advancing nodes’ states and providing assertions.

Quick Start

A simple example to run the integration test.

func TestFoo(t *testing.T) {
	// Get the binary path and setup the harness test.
	//
	// TODO: define the binary path to lnd and the name of the database
	// backend.
	harnessTest := lntemp.SetupHarness(t, binary, *dbBackendFlag)
	defer harnessTest.Stop()

	// Setup standby nodes, Alice and Bob, which will be alive and shared
	// among all the test cases.
	harnessTest.SetupStandbyNodes()

	// Run the subset of the test cases selected in this tranche.
	//
	// TODO: define your own testCases.
	for _, tc := range testCases {
		tc := tc

		t.Run(tc.Name, func(st *testing.T) {
			// Create a separate harness test for the testcase to
			// avoid overwriting the external harness test that is
			// tied to the parent test.
			ht := harnessTest.Subtest(st)

			// Run the test cases.
			ht.RunTestCase(tc)
		})
	}
}

Package Structure

This package has four major components, HarnessTest, HarnessMiner, node.HarnessNode and rpc.HarnessRPC, with the following architecture,

+----------------------------------------------------------+
|                                                          |
|                        HarnessTest                       |
|                                                          |
| +----------------+  +----------------+  +--------------+ |
| |   HarnessNode  |  |   HarnessNode  |  | HarnessMiner | |
| |                |  |                |  +--------------+ |
| | +------------+ |  | +------------+ |                   |
| | | HarnessRPC | |  | | HarnessRPC | |  +--------------+ |
| | +------------+ |  | +------------+ |  | HarnessMiner | |
| +----------------+  +----------------+  +--------------+ |
+----------------------------------------------------------+
  • HarnessRPC holds all the RPC clients and adds a layer over all the RPC methods to assert no error happened at the RPC level.

  • HarnessNode builds on top of the HarnessRPC. It is responsible for managing the lnd node, including start and stop pf the lnd process, authentication of the gRPC connection, topology subscription(NodeWatcher) and maintains an internal state(NodeState).

  • HarnessMiner builds on top of btcd’s rcptest.Harness and is responsible for managing blocks and the mempool.

  • HarnessTest builds on top of testing.T and can be viewed as the assertion machine. It provides multiple ways to initialize a node, such as with/without seed, backups, etc. It also handles interactions between nodes like connecting nodes and opening/closing channels so it’s easier to acquire or validate a desired test states such as node’s balance, mempool condition, etc.

Standby Nodes

Standby nodes are HarnessNodes created when initializing the integration test and stay alive across all the test cases. Creating a new node is not without a cost. With block height increasing, it takes significantly longer to initialize a new node and wait for it to be synced. Standby nodes, however, don’t have this problem as they are digesting blocks all the time. Thus it’s encouraged to use standby nodes wherever possible.

Currently there are two standby nodes, Alice and Bob. Their internal states are recorded and taken into account when HarnessTest makes assertions. When making a new test case using Subtest, there’s a cleanup function which further validates the current test case has no dangling uncleaned states, such as transactions left in mempool, open channels, etc.

Different Code Used in lntest

Since the miner in lntest uses regtest, it has a very fast block production rate, which is the greatest difference between the conditions it simulates and the real-world has. Aside from that, lnd has several places that use different code, which is triggered by the build flag integration, to speed up the tests. They are summarized as followings,

  1. funding.checkPeerChannelReadyInterval, which is used when we wait for the peer to send us ChannelReady. This value is 1 second in lnd, and 10 milliseconds in lntest.
  2. lncfg.ProtocolOptions, which is used to specify protocol flags. In lnd, anchor and script enforced lease are enabled by default, while in lntest, they are disabled by default.
  3. Reduced scrypt parameters are used in lntest. In lnd, the parameters N, R, and P are imported from snacl, while in lntest they are replaced with waddrmgr.FastScryptOptions. Both macaroon and aezeed are affected.
  4. The method, nextRevocationProducer, defined in LightningWallet is slightly different. For lnwallet, it will check a special pre-defined channel ID to test restoring channel backups created with the old revocation root derivation method.