Onboarding a Spring Boot based REST API Service
Onboarding a Spring Boot based REST API Service
This guide is part of a series of guides to onboard a REST API service with the Zowe API Mediation Layer. As an API developer, you can onboard your REST API service built with the Spring Boot framework with the Zowe API Mediation Layer.
Note: Before API ML version 1.2, the API ML provided an integration enabler based on Spring Cloud Netflix components. From version 1.3 and later, the API ML uses a new implementation based on the Plain Java Enabler (PJE) that is not backwards compatible with the previous enabler versions. API ML core services (Discovery Service, Gateway, and API Catalog) support both the old and new enabler versions.
Tip: For more information about how to utilize another onboarding method, see:
- Onboard a REST API service with the Plain Java Enabler (PJE)
- Onboard a REST service directly calling eureka with xml configuration
- Onboard an existing REST API service without code changes
#
Outline of onboarding a REST service using Spring BootThe following steps outline the overall process to onboard a REST service with the API ML using a Spring Boot enabler. Each step is described in further detail in this article.
Configuring your Spring Boot based service to onboard with API ML
(Optional) Validating your API service discoverability
(Optional) Troubleshooting
#
Selecting a Spring Boot EnablerAdd a dependency on the Spring Enabler version to your project build configuration that corresponds to the Spring Boot version that you use for the whole project:
- onboarding-enabler-spring-v1
- onboarding-enabler-spring-v2
Note: The process of onboarding an API service is the same for both Spring Boot enabler versions.
#
Configuring your projectUse either Gradle or Maven as your build automation system to manage your project builds.
Note: You can download the selected enabler artifact from the Zowe Artifactory for latest stable versions.. Alternatively, if you decide to build the API ML from source, it is necessary to publish the enabler artifact to your Artifactory. Publish the enabler artifact by using the Gradle tasks provided in the source code.
#
Gradle build automation systemUse the following procedure to use Gradle as your build automation system.
Follow these steps:
Create a
gradle.properties
file in the root of your project if one does not already exist.In the
gradle.properties
file, set the URL of the specific Artifactory containing the SpringEnabler artifact.# Repository URL for getting the enabler-java artifactartifactoryMavenRepo=https://zowe.jfrog.io/zowe/libs-release/
Add the following Gradle code block to the
repositories
section of yourbuild.gradle
file:repositories { ... maven { url artifactoryMavenRepo }}
In the same
build.gradle
file, add the necessary dependencies for your service. If you use the SpringEnabler from the Zowe Artifactory, add the following code block to yourbuild.gradle
script:Use the corresponding artifact according to the Spring version you are using.
For Spring boot version 2.1.1, use the following artifact:
implementation "org.zowe.apiml.sdk:onboarding-enabler-spring-v2-springboot-2.1.1.RELEASE:$zoweApimlVersion"
For Spring boot version 1.5.9, use the following artifact:
implementation "org.zowe.apiml.sdk:onboarding-enabler-spring-v1-springboot-1.5.9.RELEASE:$zoweApimlVersion"
Notes:
- You may need to add additional dependencies as required by your service implementation.
- The information provided in this file is valid for
ZoweApimlVersion 1.3.0
and above.
In your project home directory, run the
gradle clean build
command to build your project. Alternatively, you can rungradlew
to use the specific gradle version that is working with your project.
#
Maven build automation systemUse the following procedure if you use Maven as your build automation system.
Follow these steps:
Add the following XML tags within the newly created
pom.xml
file:<repositories> <repository> <id>libs-release</id> <name>libs-release</name> <url>https://zowe.jfrog.io/zowe/libs-release/</url> <snapshots> <enabled>false</enabled> </snapshots> </repository></repositories>
Tip: If you want to use snapshot version, replace libs-release with libs-snapshot in the repository url and change snapshots->enabled to true.
Add the proper dependencies
2.1 For spring version 2.1.1, use the following artifact
<dependency> <groupId>org.zowe.apiml.sdk</groupId> <artifactId>onboarding-enabler-spring-v2-springboot-2.1.1.RELEASE</artifactId> <version>$zoweApimlVersion</version></dependency>
2.2 For spring version 1.5.9, use the following artifact
<dependency> <groupId>org.zowe.apiml.sdk</groupId> <artifactId>onboarding-enabler-spring-v1-springboot-1.5.9.RELEASE</artifactId> <version>$zoweApimlVersion</version></dependency>
In the directory of your project, run the
mvn clean package
command to build the project.
#
Configuring your Spring Boot based service to onboard with API MLTo configure a Spring Boot based service, it is useful to first understand how API ML enabled service Spring Boot based configuration relates to configuration using the Plain Java Enabler.
Spring Boot expects to find the default configuration of an application in an application.yml
file that is placed on the classpath. Typically application.yml
contains Spring Boot specific properties such as properties that are used to start a web application container including TLS security, different spring configuration profiles definitions, and other properties. This application.yml
must contain the Plain Java Enabler API ML service configuration under the apiml.service
prefix. The API ML configuration under this prefix is necessary to synchronize the configuration of apiml.service
with the spring server
configuration.
Configuration properties belong to two categories:
- Service related properties which include endpoints, relative paths, or API documentation definitions.
- Environment related properties which include host names, ports, context etc.
Execution environment related properties should be provided by additional configuration mechanisms that are specific to the target execution environment. Execution environment related properties for development deployments on a local machine differ with those properties on a mainframe system.
In a development environment, provide execution environment related properties in an additional
YAML
file with the system property in the following format:-Dspring.config.additional-location=PATH_TO_YAML_FILE
On the mainframe system, provide additional configuration properties and values for existing configuration properties through Java system properties.
Execution environments for local development deployments and mainframe deployment are described in detail later in this article.
Follow these steps:
Provide a configuration section for onboarding with API ML in the
application.yml
file.If you have already onboarded your service with API ML, copy and paste the contents of your existing API ML onboarding configuration file. The default of the API ML onboarding configuration file is the
service-configuration.yml
in theapplication.yml
file under theapiml.service
prefix.If you have not yet onboarded your REST service with API ML, use the Sample API Onboarding Configuration to get started.
If you are reusing your existing API ML onboarding configuration, modify the API ML related properties of the
application.yml
file.a) Remove certain properties under the
apiml.service
section, which must be externalized. Properties for removal are described in the following sample of API ML onboarding configuration.b) Provide the following additional properties under the
apiml
section:enabled: true # If true, the service will automatically register with API ML discovery service. enableUrlEncodedCharacters: true
These additional properties are contained in the following sample.
#
Sample API ML Onboarding ConfigurationIn the following sample API ML onboarding configuration, properties prefixed with ###
(3 hashtags) indicate that their value must be provided as -Dsystem.property.key=PROPERTY_VALUE
defined in the mainframe execution environment.
The -Dsystem.property.key
must be the same as the flattened path of the YAML property which is commented out with ###
.
These properties must not be defined (uncommented) in your default service YAML configuration file.
Example:
apiml: service: ### hostname:
In this example from the YAML configuration file, when the application service is run on the mainframe, provide your mainframe hostname value on the Java execution command line in the following format:
-Dapiml.service.hostname=YOUR-MAINFRAME-HOSTNAME-VALUE
Since this value is provided in the Java execution command line, leave the property commented out in the application.yml
.
For development purposes, you can replace or add any property by providing the same configuration structure in an external YAML configuration file. When running your application, provide the name of the external/additional configuration file on the command line in the following format:
-Dspring.config.additional-location=PATH_TO_YOUR_EXTERNAL_CONFIG_FILE
A property notation provided in the format -Dproperty.key=PROPERTY_VALUE
can be used for two purposes:
To provide a runtime value for any
YAML
property if${property.key}
is used as its value (after:
) in the YAML configuration file.Example:
some_property_path: property: key: ${property.key}
To add a property to configuration if the property does not already exist.
Example:
property: key: PROPERTY_VALUE
Note: System properties provided with -D
notation on the command line will not replace properties defined
in any of the YAML configuration files.
#
API ML Onboarding Configuration Samplespring: application: name: ${apiml.service.id} # Same name as for `apiml.service.serviceId`
apiml: enabled: true # Decision if the service should automatically register with API ML discovery service enableUrlEncodedCharacters: true # Decision if the service requests the API ML GW to receive encoded characters in the URL service: # The root of API ML onboarding configuration
serviceId: ${apiml.service.id} # The symbolic name of the service. Must be the same as `spring.application.name` title: ${service.title} description: ${service.description} # API service description
scheme: https ### hostname: # Hostname must be defined by -Dapiml.service.hostname on MF ### port: # Port must be defined by -Dapiml.service.port on MF: serviceIpAddress: ${apiml.service.ipAddress} # serviceIpAddress must be provided by -Dapiml.service.ipAddress on MF
baseUrl: ${apiml.service.scheme}://${apiml.service.hostname}:${apiml.service.port} contextPath: /${apiml.service.id} # By default the contextPath is set to be the same as apiml.service.serviceId
homePageRelativeUrl: ${apiml.service.contextPath} statusPageRelativeUrl: ${apiml.service.contextPath}/application/info healthCheckRelativeUrl: ${apiml.service.contextPath}/application/health
### discoveryServiceUrls: ${apiml.service.discoveryServiceUrls} # discoveryServiceUrls must be defined by -Dapiml.service.discoveryServiceUrls on MF:
routes: - gateway-url: "ui/v1" service-url: ${apiml.service.contextPath} - gateway-url: "api/v1" service-url: ${apiml.service.contextPath}/api/v1 - gateway-url: "ws/v1" service-url: ${apiml.service.contextPath}/ws
authentication: scheme: httpBasicPassTicket applid: ZOWEAPPL
apiInfo: - apiId: org.zowe.discoverableclient version: 1.0.0 gatewayUrl: api/v1 swaggerUrl: ${apiml.service.scheme}://${apiml.service.hostname}:${apiml.service.port}${apiml.service.contextPath}/v2/api-docs documentationUrl: https://www.zowe.org
catalog: tile: id: cademoapps # Provide ID for your service Catalog tile title: Sample API Mediation Layer Applications description: Applications which demonstrate how to make a service integrated to the API Mediation Layer ecosystem version: 1.0.1
ssl: enabled: ${server.ssl.enabled} verifySslCertificatesOfServices: true ciphers: ${server.ssl.ciphers} protocol: ${server.ssl.protocol} enabled-protocols: ${server.ssl.protocol} keyStoreType: ${server.ssl.keyStoreType} trustStoreType: ${server.ssl.trustStoreType}
### DEFINE FOLLOWING PROPERTIES IN EXTERNAL CONFIGURATION keyAlias: ${server.ssl.keyAlias} #localhost-blah keyPassword: ${server.ssl.keyPassword} #password-blah keyStore: ${server.ssl.keyStore} #keystore/localhost/localhost.keystore.p12-blah keyStorePassword: ${server.ssl.keyStorePassword} #password-blah trustStore: ${server.ssl.trustStore} #keystore/localhost/localhost.truststore.p12-blah trustStorePassword: ${server.ssl.trustStorePassword} #password-blah
Optional metadata section
customMetadata: yourqualifier: key1: value1 key2: value2
server: scheme: ${apiml.service.scheme} hostname: ${apiml.service.hostname} #localhost # Hostname that is advertised in Eureka. Default is valid only for localhost port: ${apiml.service.port} #10012 # Default port name for discoverable-client service address: ${apiml.service.ipAddress} #127.0.0.1
servlet: contextPath: /${apiml.service.id}
ssl: enabled: true protocol: TLSv1.2 enabled-protocols: TLSv1.2 ciphers: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256,TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384 keyStoreType: PKCS12 trustStoreType: PKCS12
Tip: To determine if your configuration is complete, set the logging level to debug
and run your application. Setting the logging level to 'debug' enables you to troubleshoot issues with certificates for HTTPS and connections with other services.
logging: level: ROOT: INFO org.zowe.apiml: DEBUG
- Provide the suitable parameter corresponding to your runtime environment:
For a local machine runtime environment, provide the following parameter on your command line:
-Dspring.config.additional-location=PATH-TO_EXTERNAL-YAML-CONFIG-FILE
At runtime, Spring will merge the two
YAML
configuration files, whereby the properties in the external file have higher priority.For a mainframe execution environment, provide environment specific configuration properties. Define these configuration properties and provide them using Java System Properties on the application execution command line.
Important! Ensure that the default configuration contains only properties which are not dependent on the deployment environment. Do not include security sensitive data in the default configuration.
Note: For details about the configuration properties, see Configuring your service in the article Onboarding a REST API service with the Plain Java Enabler (PJE).
#
Custom Metadata (Optional) Additional metadata can be added to the instance information that is registered in the Discovery Service through the customMetadata
section. This information is propagated from the Discovery Service to onboarded services (clients). In general, additional metadata do not change the behavior of the client. Some specific metadata can configure the functionality of the API Mediation Layer. Such metadata are generally prefixed with the apiml.
qualifier. It is recommended to define your own qualifier and group the metadata you wish to publish under this qualifier. The following parameter is an example of custom metadata.
#
Api Mediation Layer specific metadatacustomMetadata.apiml.enableUrlEncodedCharacters
When this parameter is set totrue
, encoded characters in a request URL are allowed to pass through the Gateway to the service. The default setting offalse
is the recommended setting. Change this setting totrue
only if you expect certain encoded characters in your application's requests. Important! When the expected encoded character is an encoded slash or backslash (%2F
,%5C
), make sure the Gateway is also configured to allow encoded slashes. For more info see Installing the Zowe runtime on z/OS.
#
Registering and unregistering your service with API MLOnboarding a REST service with API ML means registering the service with the API ML Discovery service. The registration is triggered automatically by Spring after the service application context is fully initialized by firing a ContextRefreshed
event.
To register your REST service with API ML using a Spring Boot enabler, annotate your application main
class with @EnableApiDiscovery
.
#
Unregistering your service with API MLUnregistering a service onboarded with API ML is done automatically at the end of the service application shutdown process in which Spring fires a ContextClosed
event. The Spring onboarding enabler listens for this event and issues an unregister
REST call to the API ML Discovery service.
#
Basic routingBasic routing is based on the service ID and API version that are used to identify the service. The specific instance is selected by the API Gateway. The response needs to be the same for all instances. This is the type of routing that is expected by Eureka and Zuul.
Gateway URL format:
https://{gatewayHost}:{port}/api/v{majorVersion}/{serviceId}/{resource}
Example:
The original URL of a resource exposed by a service
http://service:10015/enablerv1sampleapp/api/v1/samples
API Gateway URL of the resource
https://gateway:10010/api/v1/enablerv1sampleapp/samples
Note: The URL identifies the resource. It does not uniquely identify the instance of the same service when multiple instances are provided by the same service (i.e. service is running in HA mode). Services of the same product that provide different resources (e.g. SYSVIEW on one system and SYSVIEW in a different sysplex) cannot have the same service ID.
In addition to the basic Zuul routing, the Zowe API Gateway adds support of versioning where a major version can be specified. The Gateway routes request only to an instance that provides the specified major version of the API.
The /api/ prefix is used for REST APIs. The /ui/ prefix is used for web UIs, and /ws/ prefix for WebSockets.
#
Adding API documentationUse the following procedure to add Swagger API documentation to your project.
Follow these steps:
Add a SpringFox Swagger dependency.
For Gradle, add the following dependency in
build.gradle
:compile "io.springfox:springfox-swagger2:2.9.2"
For Maven, add the following dependency in
pom.xml
:<dependency> <groupId>io.springfox</groupId> <artifactId>springfox-swagger2</artifactId> <version>2.9.2</version></dependency>
Add a Spring configuration class to your project.
Example:
package org.zowe.apiml.sampleservice.configuration; import org.springframework.context.annotation.Bean;import org.springframework.context.annotation.Configuration;import org.springframework.web.servlet.config.annotation.EnableWebMvc;import org.springframework.web.servlet.config.annotation.WebMvcConfigurerAdapter;import springfox.documentation.builders.PathSelectors;import springfox.documentation.builders.RequestHandlerSelectors;import springfox.documentation.service.ApiInfo;import springfox.documentation.service.Contact;import springfox.documentation.spi.DocumentationType;import springfox.documentation.spring.web.plugins.Docket;import springfox.documentation.swagger2.annotations.EnableSwagger2; import java.util.ArrayList; @Configuration@EnableSwagger2@EnableWebMvcpublic class SwaggerConfiguration extends WebMvcConfigurerAdapter { @Bean public Docket api() { return new Docket(DocumentationType.SWAGGER_2) .select() .apis(RequestHandlerSelectors.any()) .paths(PathSelectors.any()) .build() .apiInfo(new ApiInfo( "Spring REST API", "Example of REST API", "1.0.0", null, null, null, null, new ArrayList<>() )); }}
Customize this configuration according to your specifications. For more information about customization properties, see Springfox documentation.
**Note:** The current SpringFox Version 2.9.2 does not support OpenAPI 3.0.For more information about the open feature request see this [issue](https://github.com/springfox/springfox/issues/2022).
#
Validating the discoverability of your API service by the Discovery ServiceOnce you build and start your service successfully, you can use the option of validating that your service is registered correctly with the API ML Discovery Service.
Validating your service registration can be done in the API ML Discovery Service and the API ML Catalog. If your service appears in the Discovery Service UI but is not visible in the API Catalog, check to make sure that your configuration settings are correct.
Specific addresses and user credentials for the individual API ML components depend on your target runtime environment.
Note: If you are working with local installation of API ML and you are using our dummy identity provider, enter user
for both username
and password
. If API ML was installed by system administrators, ask them to provide you
with actual addresses of API ML components and the respective user credentials.
Tip: Wait for the Discovery Service to fully register your service. This process may take a few minutes after your service was successfully started.
Follow these steps:
Use the Http
GET
method in the following format to query the Discovery Service for your service instance information:https://{eureka_hostname}:{eureka_port}/eureka/apps/{serviceId}
Check your service metadata.
Response example:
<application> <name>{serviceId}</name> <instanceId>{hostname}:{serviceId}:{port}</instanceId> <hostName>{hostname}</hostName> <app>{serviceId}</app> <ipAddr>{ipAddress}</ipAddr> <status>UP</status> <port enabled="false">{port}</port> <securePort enabled="true">{port}</securePort> <vipAddress>{serviceId}</vipAddress> <secureVipAddress>{serviceId}</secureVipAddress> <metadata> <apiml.service.description>Sample API service showing how to onboard the service</apiml.service.description> <apiml.routes.api__v1.gatewayUrl>api/v1</apiml.routes.api__v1.gatewayUrl> <apiml.catalog.tile.version>1.0.1</apiml.catalog.tile.version> <apiml.routes.ws__v1.serviceUrl>/sampleclient/ws</apiml.routes.ws__v1.serviceUrl> <apiml.routes.ws__v1.gatewayUrl>ws/v1</apiml.routes.ws__v1.gatewayUrl> <apiml.catalog.tile.description>Applications which demonstrate how to make a service integrated to the API Mediation Layer ecosystem</apiml.catalog.tile.description> <apiml.service.title>Sample Service ©</apiml.service.title> <apiml.routes.ui__v1.gatewayUrl>ui/v1</apiml.routes.ui__v1.gatewayUrl> <apiml.apiInfo.0.apiId>org.zowe.sampleclient</apiml.apiInfo.0.apiId> <apiml.apiInfo.0.gatewayUrl>api/v1</apiml.apiInfo.0.gatewayUrl> <apiml.apiInfo.0.documentationUrl>https://www.zowe.org</apiml.apiInfo.0.documentationUrl> <apiml.catalog.tile.id>samples</apiml.catalog.tile.id> <apiml.routes.ui__v1.serviceUrl>/sampleclient</apiml.routes.ui__v1.serviceUrl> <apiml.routes.api__v1.serviceUrl>/sampleclient/api/v1</apiml.routes.api__v1.serviceUrl> <apiml.apiInfo.0.swaggerUrl>https://hostname/sampleclient/api-doc</apiml.apiInfo.0.swaggerUrl> <apiml.catalog.tile.title>Sample API Mediation Layer Applications</apiml.catalog.tile.title> </metadata></application>
Check that your API service is displayed in the API Catalog and all information including API documentation is correct.
Check that you can access your API service endpoints through the Gateway.
(Optional) Check that you can access your API service endpoints directly outside of the Gateway.
#
Troubleshooting#
Log messages during registration problemsWhen an Enabler connects to the Discovery service and fails, an error message prints to the Enabler log. The default setting does not suppress these messages as they are useful to resolve problems during the Enabler registration. Possible reasons for failure include the location of Discovery service is not correct, the Discovery Service is down, or the TLS certificate is invalid. These messages continue to print to the Enabler log, while the Enabler retries to connect to the Discovery Service.
To fully suppress these messages in your logging framework, set the log levels to OFF
on the following loggers:
com.netflix.discovery.DiscoveryClient, com.netflix.discovery.shared.transport.decorator.RedirectingEurekaHttpClient
Some logging frameworks provide other tools to suppress repeated messages. Consult the documentation of the logging framework you use to find out what tools are available. The following example demonstrates how the Logback framework can be used to suppress repeated messages.
Example:
The Logback framework provides a filter tool, DuplicateMessageFilter.
Add the following code to your configuration file if you use XML configuration:
<turboFilter class="ch.qos.logback.classic.turbo.DuplicateMessageFilter"> <AllowedRepetitions>0</AllowedRepetitions></turboFilter>
Note: For more information, see the full configuration used in the Core Services in GitHub.