Python package managers conda pipenv

Pipenv

This is the only virtual environment I’ve successfully got working on my WSL2 environment.

this uses pipfile and pipfile.lock to manage dependencies (not requirements.txt as is common in pip)

pipenv automatically creates and manages a virtual environment for projects.

# need pip to get pipenv 
sudo apt install python3-pip -y

# install pipenv
pip install --user pipenv

# create a new Pipfile and Pipfile.lock if not there
# otherwise get all dependencies
pipenv install

pipfile example

[[source]]
url = "https://pypi.org/simple"
verify_ssl = true
name = "pypi"

[packages]
gspread = "*"
boto3 = "*"
argparse = "*"
requests = "*"

Here is my standard test:

import sys
import requests

# 3.11.6
print("Python intepreter version:")
print(sys.version)

# 2.31.0
print("requests module version:")
print(requests.__version__)

then to run a program

pipenv run python foo.py

pyenv

pyenv - switch between versions of python

curl https://pyenv.run | bash

## got this message

WARNING: seems you still have not added 'pyenv' to the load path.

# Load pyenv automatically by appending
# the following to
# ~/.bash_profile if it exists, otherwise ~/.profile (for login shells)
# and ~/.bashrc (for interactive shells) :

export PYENV_ROOT="$HOME/.pyenv"
[[ -d $PYENV_ROOT/bin ]] && export PATH="$PYENV_ROOT/bin:$PATH"
eval "$(pyenv init -)"

# Restart your shell for the changes to take effect.

# Load pyenv-virtualenv automatically by adding
# the following to ~/.bashrc:

eval "$(pyenv virtualenv-init -)"

# restart the shell
exec bash

then

# this failed on my system
pyenv install 3.11.4

# ModuleNotFoundError: No module named '_ssl'

#   WARNING: The scripts pip3 and pip3.11 are installed in '/home/dave/.pyenv/versions/3.11.4/bin' which is not on PATH.
#   Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

# I typed the error into chat gpt and followed hints.. it was probably this that got it working
sudo apt-get install -y make build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm libncurses5-dev libncursesw5-dev xz-utils tk-dev libffi-dev liblzma-dev git

# worked
pyenv install 3.11

pyenv install 3.11.4

pyenv virtualenv 3.11.4 foo4

# is this like create?
pyenv local foo4
# or
pyenv activate foo4

# it writes a file called .python-version which includes foo4

# can select this fpyenv from vs code to run the interpreter

pyenv-virtualenv

a pyenv plugin that provides features to manage virtualenvs and conda envs for python.

Poetry

Once has pyenv setup for python 3.11.4 and working inside the environment called cir-dedeuplication

pip install poetry

poetry install

uses pyproject.toml for configuration

OTHER

Conda (Miniconda)

I can’t get this to work in my WSL2 environment. A newer version of python works, but package management dooesn’t. Am using pipenv instead.

miniconda

mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh

bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
rm -rf ~/miniconda3/miniconda.sh

# create any parent directories that dont exist
mkdir -p ~/miniconda3

# I'm running python 3.10.12 so need that from https://docs.conda.io/projects/miniconda/en/latest/miniconda-other-installer-links.html
wget https://repo.anaconda.com/miniconda/Miniconda3-py310_23.10.0-1-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh

bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3

rm -rf ~/miniconda3/miniconda.sh

# 23.10.0
conda --version

# creates an environment in  /home/dave/miniconda3/envs/gpt-vision-api
# defaulted to python 3.12.0
conda create --name gpt-vision-api

#remember to restart shell

conda activate gpt-vision-api

# to install a library use either:

# I got strange errors here from a previous install
pip install --upgrade openai
conda install xxx

# /home/dave/.pyenv/shims/python
which python

# inside the environment it is 3.12.0 and outside it is 3.10.13
python --version



# openai 1.3.8 is installed
pip list | grep open

# requests 2.31.0

# it does not seem to be working

conda deactivate

environmenet management system - including non python projects.

popular in data science

conda create --name foo python=3.10
conda activate foo

# not working for me
pip install gspread

python3 test.py

where test.py is

import sys
import requests
import gspread

# 3.9.14
print("Python intepreter version:")
print(sys.version)

# 2.28.1
print("requests module version:")
print(requests.__version__)