自建 TCP Server
Rust 提供了标准库 std::net 模块,提供网络基本功能,支持 TCP 和 UDP 通信。
下面我们将一步一步来搭建一个 TCP Server 和一个 TCP Client。
Step1 创建工作空间及项目
# 创建工作空间
cargo new s1 && cd s1
# 创建两个项目
cargo new tcpserver
cargo new tcpclient
配置 s1 目录下的 Cargo.toml:
[workspace]
members = ["tcpserver", "tcpclient"]
Step2 创建TCP Server
tcpserver/src/main.rs
use std::net::TcpListener;
fn main() {
let listener = TcpListener::bind("127.0.0.1:3000").unwrap();
println!("Running on port 3000...");
for stream in listener.incoming() {
let _stream = stream.unwrap();
println!("Connection established!");
}
}
运行:
cargo run -p tcpserver
效果如下图所示:
Step3 创建 TCP Client
tcpclient/src/main.rs
use std::net::TcpStream;
fn main() {
let _stream = TcpStream::connect("localhost:3000").unwrap();
}
新打开一个命令行窗口,运行:
cargo run -p tcpclient
运行 tcpserver 那个命令行窗口效果如下图所示:
Step4 TCP Server 收发消息
tcpserver/src/main.rs
use std::net::TcpListener;
use std::io::{Read, Write};
fn main() {
let listener = TcpListener::bind("127.0.0.1:3000").unwrap();
println!("Running on port 3000...");
for stream in listener.incoming() {
let mut stream = stream.unwrap();
println!("Connection established!");
let mut buffer = [0; 1024];
stream.read(&mut buffer).unwrap();
stream.write(&mut buffer).unwrap();
}
}
重新运行。
Step5 TCP Client 收发消息
tcpclient/src/main.rs
use std::net::TcpStream;
use std::io::{Read, Write};
use std::str;
fn main() {
let mut stream = TcpStream::connect("localhost:3000").unwrap();
stream.write("Hello".as_bytes()).unwrap();
let mut buffer = [0; 5];
stream.read(&mut buffer).unwrap();
println!(
"Response from server: {:?}",
str::from_utf8(&buffer).unwrap()
);
}
重新运行,运行 tcpclient 那个命令行窗口效果如下图所示:
自建 HTTP Server
Rust 中没有内置的 HTTP 支持,所以我们需要自己进行构建,构建的内容如下:
- Server 监听进来的 TCP 字节流
- Router 接受 HTTP 请求,并决定调用哪个 Handler
- Handler 处理 HTTP 请求,构建 HTTP 响应
- HTTP Library 解释字节流,把它转化为 HTTP 请求;把 HTTP 响应转化回字节流
构建步骤:
- 解析 HTTP 请求消息
- 构建 HTTP 响应消息
- 路由与 Handler
- 测试 Web Server
创建项目
# 创建二进制库
cargo new httpserver
# 创建 library 库
cargo new --lib http
修改 s1/Cargo.toml:
[workspace]
members = ["tcpserver", "tcpclient", "httpserver", "http"]
解析 HTTP 请求(消息)
需要的四个数据结构
| 数据结构名称 | 数据结构 | 描述 |
|---|---|---|
| HttpRequest | struct | 表示 HTTP 请求 |
| Method | enum | 指定所允许的 HTTP 方法 |
| Version | enum | 指定所允许的 HTTP 版本 |
| Resource | enum | 路径 |
需要实现的 Trait
| Trait | 描述 |
|---|---|
| From<&str> | 用于把传进来的字符串切片转化为 HttpRequest |
| Debug | 打印调试信息 |
| PartialEq | 用于解析和自动化测试脚本里做比较 |
HTTP 请求的构成
- Request Line 例如:GET(Method) /greeing(Path) HTTP/1.1(Version)
- Header Line 是 key-value 格式,例如:Host: localhost:3000; User-Agent: Curl/7.64.1; Accept: */* 等
- Empty Line
- Message body
代码实现
http/src/lib.rs 中添加:
pub mod httprequest;
http/src/httprequest.rs:
use std::collections::HashMap;
#[derive(Debug, PartialEq)] // 提供基础实现
pub enum Method {
Get,
Post, // 目前只实现 Get 和 Post 两种
Uninitialized,
}
impl From<&str> for Method {
fn from(s: &str) -> Method {
match s {
"GET" => Method::Get,
"POST" => Method::Post,
_ => Method::Uninitialized,
}
}
}
#[derive(Debug, PartialEq)]
pub enum Version {
V1_1,
V2_0,
Uninitialized,
}
impl From<&str> for Version {
fn from(s: &str) -> Version {
match s {
"HTTP/1.1" => Version::V1_1, // 暂时实现这一个
_ => Version::Uninitialized,
}
}
}
#[derive(Debug, PartialEq)]
pub enum Resource {
Path(String),
}
#[derive(Debug)]
pub struct HttpRequest {
pub method: Method,
pub version: Version,
pub resource: Resource,
pub headers: HashMap<String, String>,
pub msg_body: String,
}
impl From<String> for HttpRequest {
fn from(req: String) -> Self {
let mut parsed_method = Method::Uninitialized;
let mut parsed_version = Version::V1_1;
let mut parsed_resource = Resource::Path("".to_string());
let mut parsed_headers = HashMap::new();
let mut parsed_msg_body = "";
for line in req.lines() {
if line.contains("HTTP") {
// 处理 http 请求行
let (method, resource, version) = process_req_line(line);
parsed_method = method;
parsed_resource = resource;
parsed_version = version;
} else if line.contains(":") {
// 处理 header 行
let (key, value) = process_header_line(line);
parsed_headers.insert(key, value);
} else if line.len() == 0 {
} else {
parsed_msg_body = line;
}
}
HttpRequest {
method: parsed_method,
version: parsed_version,
resource: parsed_resource,
headers: parsed_headers,
msg_body: parsed_msg_body.to_string(),
}
}
}
fn process_req_line(s: &str) -> (Method, Resource, Version) {
let mut words = s.split_whitespace();
let method = words.next().unwrap();
let resource = words.next().unwrap();
let version = words.next().unwrap();
(
method.into(),
Resource::Path(resource.to_string()),
version.into(),
)
}
fn process_header_line(s: &str) -> (String, String) {
let mut header_items = s.split(":");
let mut key = String::from("");
let mut value = String::from("");
if let Some(k) = header_items.next() {
key = k.to_string();
}
if let Some(v) = header_items.next() {
value = v.to_string();
}
(key, value)
}
#[cfg(test)]
mod tests {
use super::*;
#[test]
fn test_method_into() {
let m: Method = "GET".into();
assert_eq!(m, Method::Get);
}
#[test]
fn test_version_into() {
let v: Version = "HTTP/1.1".into();
assert_eq!(v, Version::V1_1);
}
#[test]
fn test_read_http() {
let s: String = String::from("GET /greeting HTTP/1.1\r\nHost: localhost:3000\r\nUser-Agent: curl/7.71.1\r\nAccept: */*\r\n\r\n");
let mut headers_expected = HashMap::new();
headers_expected.insert("Host".into(), " localhost".into());
headers_expected.insert("Accept".into(), " */*".into());
headers_expected.insert("User-Agent".into(), " curl/7.71.1".into());
let req: HttpRequest = s.into();
assert_eq!(Method::Get, req.method);
assert_eq!(Version::V1_1, req.version);
assert_eq!(Resource::Path("/greeting".to_string()), req.resource);
assert_eq!(headers_expected, req.headers);
}
}
运行测试:
cargo test -p http
构建 HTTP 响应
响应体的结构
- Status Line 例如:HTTP/1.1(Version) 200 (Status code) OK(Status text)
- Header Line 是 key-value 格式,例如:Content-type: text/html; Content-Length: 30 等
- Empty Line
- Message body
需要实现的方法或 Trait
| 需要实现的方法或 Trait | 用途 |
|---|---|
| Default trait | 指定成员的默认值 |
| new() | 使用默认值创建一个新的结构体 |
| send_response() | 构建响应,将原始字节通过 TCP 传送 |
| getter 方法 | 获得成员的值 |
| From trait | 能够将 HttpResponse 转化为 String |
代码实现
http/src/lib.rs 中添加:
pub mod httpresponse;
http/src/httpresponse.rs :
use std::{collections::HashMap, io::{Write, Result}};
#[derive(Debug, PartialEq, Clone)]
pub struct HttpResponse<'a> {
version: &'a str,
status_code: &'a str,
status_text: &'a str,
headers: Option<HashMap<&'a str, &'a str>>,
body: Option<String>,
}
impl<'a> Default for HttpResponse<'a> {
fn default() -> Self {
Self {
version: "HTTP/1.1".into(),
status_code: "200".into(),
status_text: "OK".into(),
headers: None,
body: None,
}
}
}
impl<'a> From<HttpResponse<'a>> for String {
fn from(res: HttpResponse) -> String {
let res1 = res.clone();
format!(
"{} {} {}\r\n{}Content-Length: {}\r\n\r\n{}",
&res1.version(),
&res1.status_code(),
&res1.status_text(),
&res1.headers(),
&res.body.unwrap().len(),
&res1.body()
)
}
}
impl<'a> HttpResponse<'a> {
pub fn new(
status_code: &'a str,
headers: Option<HashMap<&'a str, &'a str>>,
body: Option<String>,
) -> HttpResponse<'a> {
let mut response: HttpResponse<'a> = HttpResponse::default();
if status_code != "200" {
response.status_code = status_code.into();
}
response.headers = match &headers {
Some(_h) => headers,
None => {
let mut h = HashMap::new();
h.insert("Content-Type", "text/html");
Some(h)
}
};
response.status_text = match response.status_code {
"200" => "OK".into(),
"400" => "Bad Request".into(),
"404" => "Not Found".into(),
"500" => "Internal Server Error".into(),
_ => "Not Found".into(),
};
response.body = body;
response
}
pub fn send_response(&self, write_stream: &mut impl Write) -> Result<()> {
let res = self.clone();
let response_string: String = String::from(res);
let _ = write!(write_stream, "{}", response_string);
Ok(())
}
fn version(&self) -> &str {
self.version
}
fn status_code(&self) -> &str {
self.status_code
}
fn status_text(&self) -> &str {
self.status_text
}
fn headers(&self) -> String {
let map: HashMap<&str, &str> = self.headers.clone().unwrap();
let mut header_string: String = "".into();
for (k, v) in map.iter() {
header_string = format!("{}{}:{}\r\n", header_string, k, v);
}
header_string
}
pub fn body(&self) -> &str {
match &self.body {
Some(b) => b.as_str(),
None => "",
}
}
}
#[cfg(test)]
mod tests {
use super::*;
#[test]
fn test_response_struct_creation_200() {
let response_actual = HttpResponse::new("200", None, Some("xxxx".into()));
let response_expected = HttpResponse {
version: "HTTP/1.1",
status_code: "200",
status_text: "OK",
headers: {
let mut h = HashMap::new();
h.insert("Content-Type", "text/html");
Some(h)
},
body: Some("xxxx".into()),
};
assert_eq!(response_actual, response_expected);
}
#[test]
fn test_response_struct_creation_404() {
let response_actual = HttpResponse::new("404", None, Some("xxxx".into()));
let response_expected = HttpResponse {
version: "HTTP/1.1",
status_code: "404",
status_text: "Not Found",
headers: {
let mut h = HashMap::new();
h.insert("Content-Type", "text/html");
Some(h)
},
body: Some("xxxx".into()),
};
assert_eq!(response_actual, response_expected);
}
#[test]
fn test_http_response_creation() {
let response_expected = HttpResponse {
version: "HTTP/1.1",
status_code: "404",
status_text: "Not Found",
headers: {
let mut h = HashMap::new();
h.insert("Content-Type", "text/html");
Some(h)
},
body: Some("xxxx".into()),
};
let http_string: String = response_expected.into();
let actual_string =
"HTTP/1.1 404 Not Found\r\nContent-Type:text/html\r\nContent-Length: 4\r\n\r\nxxxx";
assert_eq!(http_string, actual_string);
}
}
构建 server 模块
引入 http 包
在 httpserver 项目中引入前面实现的 http 包,在 httpserver/Cago.toml 中添加依赖:
[dependencies]
http = {path = "../http"}
代码实现
main 函数会调用 server,server 会调用 router,router 再调用 handler。
在 httpserver/src/main.rs 中使用 server 模块:
mod handler;
mod router;
mod server;
use server::Server;
fn main() {
let server = Server::new("localhost:3000");
server.run();
}
httpserver/src/server.rs
use super::router::Router;
use std::{net::TcpListener, io::Read};
use http::httprequest::HttpRequest;
pub struct Server<'a> {
socket_addr: &'a str,
}
impl<'a> Server<'a> {
pub fn new(socket_addr: &'a str) -> Self {
Server { socket_addr }
}
pub fn run(&self) {
let connection_listener = TcpListener::bind(self.socket_addr).unwrap();
println!("Running on port {}", self.socket_addr);
for stream in connection_listener.incoming() {
let mut stream = stream.unwrap();
println!("Connection established!");
let mut read_buffer = [0; 1024];
stream.read(&mut read_buffer).unwrap();
let req: HttpRequest = String::from_utf8(read_buffer.to_vec()).unwrap().into();
Router::route(req, &mut stream);
}
}
}
构建 router 模块
代码实现
httpserver/src/router.rs
use std::{io::Write};
use super::handler::{Handler, PageNotFoundHandler, StaticPageHandler, WebServiceHandler};
use http::{httprequest, httprequest::HttpRequest, httpresponse::HttpResponse};
pub struct Router;
impl Router {
pub fn route(req: HttpRequest, stream: &mut impl Write) -> () {
match req.method {
httprequest::Method::Get => match &req.resource {
httprequest::Resource::Path(s) => {
let route: Vec<&str> = s.split("/").collect();
match route[1] {
"api" => {
let resp: HttpResponse = WebServiceHandler::handle(&req);
let _ = resp.send_response(stream);
}
_ => {
let resp: HttpResponse = StaticPageHandler::handle(&req);
let _ = resp.send_response(stream);
}
}
}
}, // 暂时仅实现 get 方法
_ => {
let resp: HttpResponse = PageNotFoundHandler::handle(&req);
let _ = resp.send_response(stream);
}
}
}
}
构建 handler 模块
添加 JSON 相关依赖
使用 serde 与 serde_json 两个 crate 来进行 JSON 相关数据处理,在 httpserver/Cargo.toml 中添加依赖:
serde = {version="1.0.131", features=["derive"]}
serde_json = "1.0.72"
代码实现
httpserver/src/handler.rs
use http::{httprequest::HttpRequest, httpresponse::HttpResponse};
use serde::{Deserialize, Serialize};
use std::{env, fs, collections::HashMap};
pub trait Handler {
fn handle(req: &HttpRequest) -> HttpResponse;
fn load_file(file_name: &str) -> Option<String> {
let default_path = format!("{}/public", env!("CARGO_MANIFEST_DIR"));
let public_path = env::var("PUBLIC_PATH").unwrap_or(default_path);
let full_path = format!("{}/{}", public_path, file_name);
let contents = fs::read_to_string(full_path);
contents.ok()
}
}
pub struct StaticPageHandler;
pub struct PageNotFoundHandler;
pub struct WebServiceHandler;
#[derive(Deserialize, Serialize)]
pub struct OrderStatus {
order_id: i32,
order_date: String,
order_status: String,
}
impl Handler for PageNotFoundHandler {
fn handle(_req: &HttpRequest) -> HttpResponse {
HttpResponse::new("404", None, Self::load_file("404.html"))
}
}
impl Handler for StaticPageHandler {
fn handle(req: &HttpRequest) -> HttpResponse {
let http::httprequest::Resource::Path(s) = &req.resource;
let route: Vec<&str> = s.split("/").collect();
match route[1] {
"" => HttpResponse::new("200", None, Self::load_file("index.html")),
"health" => HttpResponse::new("200", None, Self::load_file("health.html")),
path => match Self::load_file(path) {
Some(contents) => {
let mut map: HashMap<&str, &str> = HashMap::new();
if path.ends_with(".css") {
map.insert("Content-Type", "text/css");
} else if path.ends_with(".js") {
map.insert("Content-Type", "text/javascript");
} else {
map.insert("COntent-Type", "text/html");
}
HttpResponse::new("200", Some(map), Some(contents))
}
None => HttpResponse::new("404", None, Self::load_file("404.html")),
}
}
}
}
impl WebServiceHandler {
fn load_json() -> Vec<OrderStatus> {
let default_path = format!("{}/data", env!("CARGO_MANIFEST_DIR"));
let data_path = env::var("DATA_PATH").unwrap_or(default_path);
let full_path = format!("{}/{}", data_path, "orders.json");
let json_contents = fs::read_to_string(full_path);
let orders: Vec<OrderStatus> =
serde_json::from_str(json_contents.unwrap().as_str()).unwrap();
orders
}
}
impl Handler for WebServiceHandler {
fn handle(req: &HttpRequest) -> HttpResponse {
let http::httprequest::Resource::Path(s) = &req.resource;
let route: Vec<&str> = s.split("/").collect();
// localhost:3000/api/shipping/orders
match route[2] {
"shipping" if route.len() > 2 && route[3] == "orders" => {
let body = Some(serde_json::to_string(&Self::load_json()).unwrap());
let mut headers: HashMap<&str, &str> = HashMap::new();
headers.insert("Content-Type", "application/json");
HttpResponse::new("200", Some(headers), body)
}
_ => HttpResponse::new("404", None, Self::load_file("404.html"))
}
}
}
添加页面和 JSON
httpserver/src/data/orders.json
[
{
"order_id": 1,
"order_date": "21 Jan 2020",
"order_status": "Delivered"
},
{
"order_id": 2,
"order_date": "2 Feb 2020",
"order_status": "Pending"
}
]
httpserver/src/public/404.html
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>404</title>
</head>
<body>
<h1>404 Error</h1>
<p>Sorry the requested page does not exist</p>
</body>
</html>
httpserver/src/public/index.html
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<link rel="stylesheet" href="styles.css">
<title>Index!</title>
</head>
<body>
<h1>Hello, wellcome to home page</h1>
<p>This is the index page for the web site</p>
</body>
</html>
httpserver/src/public/health.html
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<title>Health!</title>
</head>
<body>
<h1>Hello, wellcome to health page</h1>
<p>This site is perfectly fine</p>
</body>
</html>
httpserver/src/public/styles.css
h1 {
color: red;
margin-left: 25px;
}
运行项目:
cargo run -p httpserver