Книги
Elixir
Розділ 11. HTML та веб
Завантаження веб-сторінки

Elixir:
Завантаження веб-сторінки

Як це зробити:

Elixir makes it easy with libraries like HTTPoison or Mint. Here’s a quick example using HTTPoison.

# Add HTTPoison to your mix.exs dependencies
defp deps do
  [
    {:httpoison, "~> 1.8"}
  ]
end

# Run mix deps.get to install the dependency

# Now, you can use HTTPoison to download a web page
defmodule WebPageDownloader do
  def get_page_content(url) do
    case HTTPoison.get(url) do
      {:ok, %HTTPoison.Response{status_code: 200, body: body}} ->
        body
      {:error, %HTTPoison.Error{reason: reason}} ->
        {:error, reason}
    end
  end
end

# Sample usage
IO.puts WebPageDownloader.get_page_content("https://example.com")

Sample output could be the HTML content of “https://example.com”.

Поглиблений розгляд:

Initially, Elixir relied on :httpc module from Erlang. However, the community desired improved usability & performance, leading to libraries like HTTPoison, based on hackney, and Mint, a newer, low-level HTTP client.

Alternatives to HTTPoison include Mint for more control and Tesla for a flexible middleware-based approach. Mint provides a neat interface for concurrent stream handling but requires more manual work, while Tesla lets you swap HTTP clients and add features like logging.

When downloading a webpage, handling redirects, SSL, and compressed content are considerations. Libraries address these. For example, HTTPoison auto-follows redirects and handles SSL.

Дивіться також:

Аналіз HTML