)

This commit implements balance events for UTXOs and fixes an electrum notification receiving bug.

…Cs (#2015)

This commit does the following:
- Implements WASM storage for upgraded swaps.
- Implements old swaps data migration.
- Swaps kickstart on MM2 reload.
- Swaps file lock, preventing the same swap from starting from different processes.
- my_swap_status, my_recent_swaps V2 RPCs.
- V1 RPCs can also return upgraded swaps data.
- Adds BoolAsInt struct because boolean can be used as IndexedDb indexes.
- Implements refund states for both swap types.

*Important note:
- Seednodes should be updated to support/rebroadcast new swap protocol messages.

This commit adds support for witness inputs and outputs for withdraw tx to sign it with trezor device. It also adds a test tool to sign withdraw tx with witness inputs/outputs with trezor and emulator.

This commit implements balance events for ETH plus error events.

This commit does the following:
* Adds address builder pattern
* Adds `script_type` field to Address structure
* Refactors output script creation
* Replaces use of u8 addr prefixes to a strict type `NetworkAddressPrefixes`

This commit does the following:
* It introduces two new functions, erc1155_balance and erc721_owner, to the EthCoin structure. These enhancements streamline the NFT withdrawal process in the withdraw_nft RPC by directly interacting with smart contracts for validation, eliminating the need to access database information.
* It adds a new clear_nft_db RPC for NFT data management. This new method allows users to selectively clear NFT data for specified blockchain networks, or to completely wipe it across all supported chains.

This commit adds the ability to detect the current execution environment (window or worker) and follows the appropriate way of getting `web_sys::IdbFactory` instance depending on it.

Signed-off-by: onur-ozkan <[email protected]>

…2046)

What's done:
- Locked amount handling for UTXO swaps (more work will be needed for ETH/ERC20)
- Implemented conditional wait for maker payment confirmation before signing funding tx spend preimage on taker's side.
- active_swaps V2 RPC
- Handling accept_only_from for swap messages (validation of the sender)
- Added swap_uuid for swap v2 messages to avoid reusage of the messages generated for other swaps
- Implemented maker payment immediate refund path handling
- Implemented KMD dex fee burn for upgraded swaps
- Added dockerized Geth node for ETH-related integration tests (more to be done in the next sprints)
- Fixed ETH watcher tests

Updated deps:
- test-containers (other Cargo.lock updates are triggered by it). The purpose is to rely on the official version instead of using the fork. The fork also didn't allow passing additional arguments to the image (only `docker run` options were available).

This commit implements the following:
- ETH websocket transport.
   - komodo-defi-proxy signed messages.
   - expirable hashmap, so that request contexts can be cleaned after timeout.
- Refactor web3 contexts, connection rotation and remove singular `web3` field from ETH coin.
- Heartbeats implementation for streaming channels.
- Refactored node rotation (moved from transport to protocol level, so it can be rotated across different transports)
- RPC abstraction for ETH

This commit introduces the functionality to enable EVM based coin as a platform coin along with its associated Non-Fungible Tokens (NFTs) owned by user. It includes enable_nft implementation, which works same way as enable_erc20.

)

This commit allows any worker path to be used instead of hardcoded worker.js file. The worker path can be specified using worker_path in event_stream_configuration, if not specified worker.js will be used as default. Also, shared worker is used to allow using event streaming worker from multiple contexts.

This commit adds several new filtering features to the mm2 indexedb crate, including limit, offset, with a minor fix for where_ condition/option

`z_coin_tx_history` should now work in wasm

This commit implements balance event streaming for zcoin for Native and WASM targets. After each update to the wallet database with a new block, a check for transactions within the block is done. If transactions are detected, the latest balance is sent through the streaming channel.

Previously, encountering an error on any type of request, even if it was invalid, would result in a failure due to not being able to find a live RPC client error. This is obviously not correct, and this commit fixes this by returning the correct errors.

Introduce Wallet Name and Password for Enhanced Seed Management

This commit introduces a new optional parameter, `wallet_name`, to the mm2 configuration. This parameter, along with `wallet_password`, allows for enhanced seed management by MM2, reducing the need for GUIs to handle seed management. 

If `wallet_name` and `wallet_password` are provided, MM2 will handle the generation, encryption, and storage of the wallet's seed. If a `passphrase` is also provided, it will be used as the seed and then encrypted and stored. If no `passphrase` is provided, MM2 will generate a new seed, encrypt it, and store it. 

This commit also introduces a new API method `get_mnemonic` that allows for the retrieval of the wallet's seed, either in encrypted or plaintext format, depending on the provided parameters.

This change enhances the security and flexibility of seed management in MM2, allowing for different modes of operation depending on the user's needs.

This commit does the following:
* Stops sending sync status after main sync state (main improvement).
* Removes first_sync_block from SyncStatus and stop sending first_sync_block  while activation is in progress.
* include first_sync_block in Activation Result only after activation is completed.

This commit implements the NFT maker payment sending, validating, spending and refunding. This process is tested using the dockerized geth dev node.

…#2095)

This makes `aes` version in mm2 `v0.8.3` except for `rust-libp2p` `aes` dep

This commit fixes failing tests, updates tendermint deps. In addition to this, it updates some other deps and fixes a few minor issues.

* add nucleus htlc definitions

Signed-off-by: onur-ozkan <[email protected]>

* save dev state

Signed-off-by: onur-ozkan <[email protected]>

* try to unify iris and nucleus htlc definitions

Signed-off-by: onur-ozkan <[email protected]>

* abstract nucleus and iris htlc types

Signed-off-by: onur-ozkan <[email protected]>

* implement `HtlcType` for multi-support cosmos HTLCs

Signed-off-by: onur-ozkan <[email protected]>

* implement various inner abstraction functions

Signed-off-by: onur-ozkan <[email protected]>

* complete abstraction over iris & nucleus htlcs

Signed-off-by: onur-ozkan <[email protected]>

* create `htlc::get_htlc_abci_query_path`

Signed-off-by: onur-ozkan <[email protected]>

* update tendermint swap tests

Signed-off-by: onur-ozkan <[email protected]>

* replace rick with doc

Signed-off-by: onur-ozkan <[email protected]>

* make test_htlc_create_and_claim work by fixing pair2 address

Signed-off-by: onur-ozkan <[email protected]>

* add ibc swap tests

Signed-off-by: onur-ozkan <[email protected]>

* fix WASM test

Signed-off-by: onur-ozkan <[email protected]>

* use iris for tendermint unit tests

Signed-off-by: onur-ozkan <[email protected]>

* fix ABCI paths

Signed-off-by: onur-ozkan <[email protected]>

* document tendermint HTLC implementation

Signed-off-by: onur-ozkan <[email protected]>

* use rick in best orders test

Signed-off-by: onur-ozkan <[email protected]>

* replace doc confs with rick

Signed-off-by: onur-ozkan <[email protected]>

* revert mm2_tests_inner.rs

Signed-off-by: onur-ozkan <[email protected]>

---------

Signed-off-by: onur-ozkan <[email protected]>

This commit eliminates the dependency on ETH_DEV_NODE from all tests and utilizes the Sepolia network in some tests instead. It also removes the test_send wasm test, which would require periodic funding if retained. Lastly, it fixes some issues in mac CI.

…2099)

This commit fixes `BCH` block header deserialization by making it the same as `BTC`

This commit does the following:
- Adds skeleton Sia integration to demonstrate the code organization.
- Mocks the minimal amount of functionality to support enabling a "sia protocol" coin
- Implements PoC of HTTP(s) interface between mm2 and Sia's walletd node software
- Implements 2 walletd endpoints, GET `api/consensus/tip` and GET `api/addresses/<address>/balance`
- Adds conditional compilation for all sia features

- Full UTXO HD wallet functionalities are implemented. UTXO HD wallet now uses the same APIs used for Trezor except for withdraw were `withdraw` is used for HD wallet and `task::withdraw` for Trezor.
 - `path_to_address` in activation now uses `HDAccountAddressId` struct, `StandardHDCoinAddress` was removed to reduce redundancies.
- `task::create_new_account` can now take an optional parameter `account_id` to specify the new account index instead of just incrementing the account index. If not specified, incrementing will be used as before.
- `WithdrawFrom` also uses `HDAccountAddressId` instead of `StandardHDCoinAddress`, a full derivation path can be also used to specify the address to withdraw from, this makes specifying the address more easy since the full derivation path is what is returned in the response of activation/`account_balance`/etc..
- HD wallet and trezor is implemented for EVM coins/tokens alongside new task manager activation methods.

Signed-off-by: onur-ozkan <[email protected]>

Signed-off-by: onur-ozkan <[email protected]>

Consolidate all the runtime files together under $HOME/.kdf by default (so you don't have to set environment variables on the host). This should improve the user experience significantly as this is a standard practice followed by most of the programs on UNIX systems.

This commit improves memory usage a bit by doing preallocation when possible

This commit adds missed apply_event for events discovered while taker was offline, like the maker spent or watcher refunded the taker payment.

…ir (#2115)

`sign_and_send_transaction_with_keypair` now uses the address provided from the caller instead of having `my_address` inside it.

Testnet bitcoin currently has high fees which causes some tests to fail due to not enough balance. Since failing tests don't send actual tbtc, this commit sets a fixed fee to fix these tests.

This commit implements pubkey-only mode for the Tendermint protocol, which means we can use any external wallet for wallet and swap operations on Tendermint.

Additionally, ibc_withdraw RPC is removed and withdraw is refactored for Tendermint to support IBC transfers by automatically finding IBC channels whenever possible.

This avoids concurrent reading/writing by enabling .tmp file for swap and order files. This fix should not create a problem for two mm2 instances running on the same node as both would use different directories for their data, derived from different listening IP-addresses.

UTXO P2PK balance is shown as part of the P2PKH/Legacy address balance, it can be also spent in withdraws and swaps.

This commit does the following:
* Adds eth EIP1559 priority fee estimator
* Adds tx priority fee support for withdraw and swaps
* Improve gas limit for swap txns

Test test_taker_completes_swap_after_taker_payment_spent_while_offline sometimes fails, apparently due to too early taker stop, so it does not have time to send p2p message with taker payment data to the maker.
This fix improves the test log wait condition to ensure the p2p message is sent and only then taker stops.

Addresses bunch of potential database problems by improving the validation function.

Fixes a regression (check mm2_tests::tendermint_tests::test_tendermint_withdraw_hd test) which started with pubkey-only activation implementation.

* handle base64 encoded transaction values

Signed-off-by: onur-ozkan <[email protected]>

* add coverage for history parsing

Signed-off-by: onur-ozkan <[email protected]>

* increase test coverage

Signed-off-by: onur-ozkan <[email protected]>

---------

Signed-off-by: onur-ozkan <[email protected]>

This commit tries to get global with type safety and explicit type conversion

This commit Implementats the following SwapOps trait methods for SolanaCoin:
- send_maker_payment
- send_taker_spends_maker_payment
- send_maker_refunds_payment

It also adds Tests for sending, spending and refunding of maker payments.

…2148)

This commit enables Tendermint transaction functionality for Ledger HW wallet using Keplr. However, HTLC transactions and swap operations are not yet supported, as Keplr has not implemented SIGN_MODE_TEXTUAL yet.

…2153)

This commit renames mm2 binaries to kdf while also producing a copy that uses mm2 naming for backward compatibility. For wasm, only kdf named binaries are provided.

)

- Run local ATOM testnet in container for integration tests
- Run local NUCLEUS testnet in container for integration tests
- Add IBC relayer node in container connected to both testnets
- Include test coverage for Tendermint - ETH swap
- Use .docker/container-state for consistent testnet initial state

* install `paramiko` in CI container

Signed-off-by: onur-ozkan <[email protected]>

* create artifact uploader python script

Signed-off-by: onur-ozkan <[email protected]>

* use in-tree script for uploading artifacts

Signed-off-by: onur-ozkan <[email protected]>

* extend deps-install composite pipeline

Signed-off-by: onur-ozkan <[email protected]>

* apply review notes

Signed-off-by: onur-ozkan <[email protected]>

* apply review note

Signed-off-by: onur-ozkan <[email protected]>

---------

Signed-off-by: onur-ozkan <[email protected]>

Signed-off-by: onur-ozkan <[email protected]>

…2155)

This commit makes tendermint to use more precise max amount for withdraw operations by removing the estimated fee (by simulating the transaction) from it.

This commit introduces containers runtime directories for dockerized tests to ensure files consistency with each run and prevent local file changes with each test execution.

Extends `common::http_uri_to_ws_address` helper to include address path.

This commit adds macOS target on Apple Silicon. Komodo wallet GUI has a new dependency that is incompatible with x86 architecture on macOS, breaking the current solution of building for x86 and running on Rosetta.

* resolve the expected sequence number locally

Signed-off-by: onur-ozkan <[email protected]>

* drop SWAP locks for tendermint tests

Signed-off-by: onur-ozkan <[email protected]>

* bless clippy

Signed-off-by: onur-ozkan <[email protected]>

* chain regex options

Signed-off-by: onur-ozkan <[email protected]>

* update account sequence error message

Signed-off-by: onur-ozkan <[email protected]>

---------

Signed-off-by: onur-ozkan <[email protected]>

)

This commit does the following:
- Increases the default consts for erc20 ops (to the old value actually) to ensure proxied erc20 would have enough gas.
- adds `gas_limit` param that can be set in coins config to allow setting lower (or higher) gas limits for selected tokens.

This commit introduces the following key changes related to issue #900:

- Implement standalone NFT maker swap contract (EtomicSwapMakerNftV2)
- Add komodefi-proxy support for NFT feature, enabling HTTP GET requests

Additional changes include:
- Implement Multi Standalone Etomic Swap contracts approach
- Add support for EtomicSwapTakerV2 contract
- Enhance security with checks for malicious token_uri links
- Make clear_all parameter optional in clear_nft_db RPC (default: false)
- Implement Sepolia testnet support for testing

This change adopts the new Etomic swap implementation approach as discussed in KomodoPlatform/etomic-swap#7 (comment)

…on warning (#2177)

…2179)

…in (#2184)

This commit creates new `sign_low_r` function and keeps using regular sign for `derive_htlc_key_pair` of zcoin