AI inference deployment orders

The TPU-based deployment of the Utility network possess the mature AI model training and inference environment, and therefore also it can be intro- duced to the inference deployment order service. The inference deployment order allows users to use TPU resources on the chain to perform daily infer- ence algorithms on the AI models being trained. Suppose R represent an inference rental order, which includes the following main elements:

u: User

t: Rental time in seconds

r: Computing resource requirements (e.g. number of CPU cores, memory size, etc.)

m: The trained algorithm model

d: trained data corpus

p: user bid (in UNC)

s: Service provider

f : Scoring transactions

v: Validation result set

The process of sending an order to the chain can be expressed as follows:

R(u,t,r,m,d,p,s,f,v) → UilityNet (25)

Similarly, once an order is sent to the chain, the computing resources providers in the network will decide whether to accept the order based on the user’s requirements and bids. After accepting the order, the service provider needs to allocate resources according to the user’s model, data and environment requirements, complete the encrypted file signing, and provide specific AI training infer- ence services during the rental period.

After the user receives the inference results, the system will verify the results to ensure the ac- curacy and security of the results. The validation process includes digital signature verification of results, data integrity verification, algorithm inter- pretability verification, etc. Only the results that pass the validation will be considered as valid in- ference results.

Once the inference deployment order is com- pleted, like the machine time rental order, the user and the service provider for scoring transactions,verification, the system will automatically carry out the settlement, and the cost will be allocated to the nodes involved in the inference deployment and deposit returned to the user. From request to liquidation, all the processes are automatically exe- cuted by the blockchain smart contract order, and the security and fair performance of the fees are guaranteed to the maximum.