1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119
// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership. The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing,
// software distributed under the License is distributed on an
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
// KIND, either express or implied. See the License for the
// specific language governing permissions and limitations
// under the License.
use std::cmp::Ordering;
use futures::Stream;
use futures::StreamExt;
use oio::Read;
use crate::raw::*;
use crate::*;
/// HttpBody is the streaming body that opendal's HttpClient returned.
///
/// It implements the `oio::Read` trait, service implementors can return it as
/// `Access::Read`.
pub struct HttpBody {
#[cfg(not(target_arch = "wasm32"))]
stream: Box<dyn Stream<Item = Result<Buffer>> + Send + Sync + Unpin + 'static>,
#[cfg(target_arch = "wasm32")]
stream: Box<dyn Stream<Item = Result<Buffer>> + Unpin + 'static>,
size: Option<u64>,
consumed: u64,
}
/// # Safety
///
/// HttpBody is send on non wasm32 targets.
unsafe impl Send for HttpBody {}
/// # Safety
///
/// HttpBody is sync on non wasm32 targets.
unsafe impl Sync for HttpBody {}
impl HttpBody {
/// Create a new `HttpBody` with given stream and optional size.
#[cfg(not(target_arch = "wasm32"))]
pub fn new<S>(stream: S, size: Option<u64>) -> Self
where
S: Stream<Item = Result<Buffer>> + Send + Sync + Unpin + 'static,
{
HttpBody {
stream: Box::new(stream),
size,
consumed: 0,
}
}
/// Create a new `HttpBody` with given stream and optional size.
#[cfg(target_arch = "wasm32")]
pub fn new<S>(stream: S, size: Option<u64>) -> Self
where
S: Stream<Item = Result<Buffer>> + Unpin + 'static,
{
HttpBody {
stream: Box::new(stream),
size,
consumed: 0,
}
}
/// Check if the consumed data is equal to the expected content length.
#[inline]
fn check(&self) -> Result<()> {
let Some(expect) = self.size else {
return Ok(());
};
let actual = self.consumed;
match actual.cmp(&expect) {
Ordering::Equal => Ok(()),
Ordering::Less => Err(Error::new(
ErrorKind::Unexpected,
format!("http response got too little data, expect: {expect}, actual: {actual}"),
)
.set_temporary()),
Ordering::Greater => Err(Error::new(
ErrorKind::Unexpected,
format!("http response got too much data, expect: {expect}, actual: {actual}"),
)
.set_temporary()),
}
}
/// Read all data from the stream.
pub async fn to_buffer(&mut self) -> Result<Buffer> {
self.read_all().await
}
}
impl oio::Read for HttpBody {
async fn read(&mut self) -> Result<Buffer> {
match self.stream.next().await.transpose()? {
Some(buf) => {
self.consumed += buf.len() as u64;
Ok(buf)
}
None => {
self.check()?;
Ok(Buffer::new())
}
}
}
}